DATA ENGINEER - SC CLEARED

REQUIRED: DATA ENGINEER - SC CLEARED

Location:

Fully remote with occasional travel to Central London

IR35 Status:

Inside

Duration:

6-month initial contract

Job Description:

Seeking a Data Engineer with a strong understanding of data concepts, including data types, data structures, schemas (JSON and Spark), and schema management.

Key Skills and Experience:

1. 
   
2. Strong understanding of complex JSON manipulation
   
3. Experience with Data Pipelines using custom Python/PySpark frameworks
   
4. Knowledge of the 4 core Data categories (Reference, Master, Transactional, Freeform) and handling Reference Data
   
5. Understanding of Data Security principles, access controls, GDPR, and handling sensitive datasets
   
6. Strong problem-solving and analytical skills
   
7. Experience in support roles, incident triage, and handling (SLAs)
   
8. Linux system administration basics, Bash scripting, environment variables
   
9. Experience with browser-based IDEs like Jupyter Notebooks
   
10. Familiarity with Agile methodologies (SAFE, Scrum, JIRA)
    

Languages and Frameworks:

• 
  
• JSON
  
• YAML
  
• Python (advanced proficiency, Pydantic bonus)
  
• SQL
  
• PySpark
  
• Delta Lake
  
• Bash
  
• Git
  
• Markdown
  
• Scala (bonus)
  
• Azure SQL Server (bonus)
  

Technologies:

• 
  
• Azure Databricks
  
• Apache Spark
  
• Delta Tables
  
• Data processing with Python
  
• PowerBI (Data ingestion and integration)
  
• JIRA
  

Additional Notes:

Candidates with current or past high-level security clearance are encouraged to apply. Successful candidates will need to undergo security clearance, which may take up to 10 weeks.

LA International is a globally operating, HMG-approved ICT Recruitment and Project Solutions Consultancy, committed to diversity and inclusion.

Recognitions include multiple awards, including The Queen's Award for Enterprise: International Trade.

#J-18808-Ljbffr