Big Data Engineer (Elastic Search)

Talent Solutions - Northrup Grumman RPO
London
1 week ago
Create job alert

UK CITIZENSHIP REQUIRED FOR THIS POSITION: Yes
RELOCATION ASSISTANCE: Relocation assistance may be available
CLEARANCE TYPE: UK-Highest Level of Government Clearance
TRAVEL: Yes, 10% of the Time
Salary: £77,400 - £116,000

Define Possible at Northrop Grumman UK

At Northrop Grumman UK, our mission is to solve the most complex challenges by shaping the technology and solutions of tomorrow. We call it Defining Possible.

This mind-set goes beyond our customer solutions; it's the foundation for your career development and the impact we have within the community. So, what's your possible?

Opportunity:

This is more than just a job; it's a mission.

As a Big Data Systems Engineer, you will be responsible for designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads. You will work closely with cross-functional teams to ensure seamless data integration, security, and compliance with GDPR and privacy regulations. Your expertise in scripting, troubleshooting, and integration testing will be essential in optimizing our data pipelines and orchestration processes.

Our UK Cyber & Intelligence business combines modern software development approaches with a rich heritage and experience in the Defence and security sectors. Our customers have complex and sensitive data and information requirements requiring a mission partner who quickly understands the context, delivering and sustaining a portfolio of challenging technology projects at scale and pace, supporting them through an ambitious digital transformation programme.

If you are looking for a career with meaning where you can make a difference to the nation's security and support critical missions, then look no further.

"My purpose; to lead a team of engineers with the brightest minds, to push the boundaries and define possible together."

Role responsibilities:

Scripting and Automation: Develop and maintain scripts for automating data processes and workflows.

Troubleshooting: Diagnose and resolve technical issues related to big data systems, data pipelines, and integrations.

Integration Testing: Conduct thorough testing to ensure seamless integration of new tools and technologies into existing systems.

Linux Internals: Utilize in-depth knowledge of Linux internals to optimize performance and reliability of big data infrastructure.

Network Protocols: Apply understanding of TCP/IP and OSI models in the design and troubleshooting of networked systems.

Data Pipeline Support: Manage and optimize data pipelines and orchestration tools such as NiFi and Airflow.

Scalable System Design: Design scalable big data systems with a focus on security, GDPR compliance, and privacy

Hybrid Cloud Management: Leverage hybrid cloud experience to manage on-premise and AWS cloud resources effectively

Data Science Support: Support data science, machine learning, and AI workloads using tools like Jupyter, Spacy, Transformers, and NLTK.

Big Data Platforms: Utilize big data NoSQL engines and platforms such as Hive, Impala, and Elasticsearch for data storage and processing

BI and Visualization: Implement and support business intelligence and visualization tools like Tableau, Kibana, and PowerBI to provide actionable insights.

We are looking for:

Strong troubleshooting skills and the ability to diagnose and resolve complex technical issues.

Experience with integration testing and ensuring seamless tool integration.

In-depth knowledge of Linux internals and system administration.

Understanding of TCP/IP and OSI models.

Hands-on experience with data pipeline tools like NiFi and Airflow.

Proven ability to design scalable big data systems with a focus on security and GDPR compliance.

Hybrid cloud experience, specifically with on-premise and AWS cloud environments.

Familiarity with data science, machine learning, and AI tools such as Jupyter, Spacy, Transformers, and NLTK.

Experience with big data NoSQL engines/platforms such as Hive, Impala, and Elasticsearch.

Proficiency with business intelligence and visualization tools like Tableau, Kibana, and PowerBI.

Excellent communication and collaboration skills.

Preferred Qualifications:

Certification in AWS or other cloud platforms.

Experience with additional data orchestration tools.

Familiarity with other big data tools and technologies.

Previous experience in a similar role within a dynamic and fast-paced environment.

Experience in Cloudera, Hadoop, Cloudera Data Science Workbench (CDSW), Cloudera Machine Learning (CML) would be highly desirable.

Work Environment:

Full time on-site presence required

If you don't meet every single requirement, we still encourage you to apply.

Sometimes, people hesitate to apply because they can't tick every box. We encourage you to apply if you believe the role will suit you well, even if you don't meet all the criteria. You might be exactly who we are looking for, either for this position or for our opportunities at Northrop Grumman UK. We are on an exciting growth trajectory and growing our teams across the UK.

Security clearance:

You must hold the highest level of UK Government security clearance. Our requirement team is on hand to answer any questions and we will guide you through the process: .

Benefits:

We can offer you a range of flexible working options to suit you, including optional compressed working schedule with every other Friday off. Our benefits including private health care, cash health plan, holiday buy and sell, career development opportunities and performance bonuses. For a comprehensive list of benefits, speak to our recruitment team.

Why join us?

A mission to believe in - Every day we contribute to building a more secure and connected world, expanding our reach from land, sea, and air to space and cyberspace. From engineering data and intelligence solutions, to developing maritime navigation and control systems and innovating command and control systems for the UK and NATO, what we do together matters.

A place to belong and thrive - Every voice matters at our table meaning you can bring your authentic self to work. From our Employee Resource Groups backed by thousands of employees to our partnerships with the Association For Black and Minority Ethnic Engineers, Forces Transition Group, Mind, and Women in Defence - we are passionate about growing and supporting our inclusive community where everyone can belong.

Your career, your way - Shape your career journey with diverse roles, mentorship, and development opportunities that fuel your curiosity, channel your expertise, and nurture your passion. Looking for flexibility? Balance your professional career with your personal life through our health and wellbeing benefits, discount schemes, and investment in your future development. Speak to our team to find the balance that's right for you.

Ready to apply?

Yes - Submit your application online. Your application will be reviewed by our team and we will be in touch.

Possibly, I'd like to find out more about this role - Reach out to our team for more information and support: .

No, I don't think this role is right for me - Our extensive UK growth means we have exciting, new opportunities opening all the time. Speak to our team to discuss your career goals.

Northrop Grumman is committed to hiring and retaining a diverse workforce, and encourages individuals from all backgrounds and all abilities to apply and consider becoming a part of our diverse and inclusive workforce.ZGFuaWVsLndvb2Rlci4yNDk1MS4xMjI3MUBub3J0aHJ1cG1hbi5hcGxpdHJhay5jb20.gif

Related Jobs

View all jobs

Snr Data Engineer

Senior Data Architect

Data Warehouse Engineer

Data Engineer - Big Data

Senior Azure Data Engineer - UK remote

Data Engineering Lead

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Top 10 Mistakes Candidates Make When Applying for Machine-Learning Jobs—And How to Avoid Them

Landing a machine-learning job in the UK is competitive. Learn the 10 biggest mistakes applicants make—plus tested fixes, expert resources and live links that will help you secure your next ML role. Introduction From fintechs in London’s Square Mile to advanced-research hubs in Cambridge, demand for machine-learning talent is exploding. Job boards such as MachineLearningJobs.co.uk list new vacancies daily, and LinkedIn shows more than 10,000 open ML roles across the UK right now. Yet hiring managers still reject most CVs long before interview—often for avoidable errors. Below are the ten most common mistakes we see, each paired with a practical fix and a live resource link so you can dive deeper.

Top 10 Best UK Universities for Machine Learning Degrees (2025 Guide)

Explore ten UK universities that deliver world-class machine-learning degrees in 2025. Compare entry requirements, course content, research strength and industry links to find the programme that fits your goals. Machine learning (ML) has shifted from academic curiosity to the engine powering everything from personalised medicine to autonomous vehicles. UK universities have long been pioneers in the field, and their programmes now blend rigorous theory with hands-on practice on industrial-scale datasets. Below, we highlight ten institutions whose undergraduate or postgraduate pathways focus squarely on machine learning. League tables move each year, but these universities consistently excel in teaching, research and collaboration with industry.

How to Write a Winning Cover Letter for Machine Learning Jobs: Proven 4-Paragraph Structure

Learn how to craft the perfect cover letter for machine learning jobs with this proven 4-paragraph structure. Ideal for entry-level candidates, career switchers, and professionals looking to advance in the machine learning sector. When applying for a machine learning job, your cover letter is a vital part of your application. Machine learning is an exciting and rapidly evolving field, and your cover letter offers the chance to demonstrate your technical expertise, passion for AI, and your ability to apply machine learning techniques to solve real-world problems. Writing a cover letter for machine learning roles may feel intimidating, but by following a clear structure, you can showcase your strengths effectively. Whether you're just entering the field, transitioning from another role, or looking to advance your career in machine learning, this article will guide you through a proven four-paragraph structure. We’ll provide practical tips and sample lines to help you create a compelling cover letter that catches the attention of hiring managers in the machine learning job market.