Data Quality Tester Databricks (m/f/d)
Responsibilities
- Develop and execute automated data and integration tests in Databricks (Python, PySpark, SQL)
- Conduct end-to-end pipeline testing from SCADA through AMQP into Databricks, including verification of transformation logic and compliance with defined business rules
- Capture, store, and prepare test results using Azure services (Data Lake, Blob Storage, SQL)
- Integrate automated tests into CI/CD pipelines with Azure DevOps, collaborating closely with DevOps and Cloud teams to ensure continuous validation and monitoring
- Work closely with Data Engineers, SCADA specialists, and Cloud architects, ensuring full documentation of all test cases, procedures, and outcomes for transparency and traceability
Profile
- Knowledge of Python, PySpark/SQL
- Knowledge of Databricks
- Knowledge of Azure Services for storing and prepare results
- Knowledge of Azure DevOps
- Knowledge of SCADA is advantageous
Benefits
- Start date: asap
- Remote-option
About Hays
IT is and always has been our core business that laid the foundation for Hays' success. We are the biggest privately owned IT recruitment agency in Germany and offer the best jobs for every career level – whether you are interested in vacancies in agile SMEs or international DAX groups. Hays masters the entire IT job spectrum, from support to software architecture or digitalisation – thanks to our broad portfolio, we have something for everyone. In the last decades, we were able to support numerous IT experts with choosing the right path for a successful career, positioning ourselves as their lifelong partner. Our highly specialised consultants can cater to your every wish and expectation and will prepare you for interviews and contract negotiations. Give it a try and learn what the market has to offer – our services are free of charge, non-binding and discreet! We look forward to hearing from you.
Staffing process for freelance specialists
- Analysis of qualifications
- Telephone or personal interview
- Contact with customers
- Contract with Hays
- 1
- 2
- 3
- 4
1. Analysis of qualifications
We carry out a detailed analysis of your technical qualifications on the basis of your CV, your application documents and your profile.
Contact at Hays
+ 49 621 1788-4297© Copyright Hays plc, . The HAYS word, the H devices, 'Hays Working for your tomorrow' and 'Powering the world of work' and associated logos and artwork are trademarks of Hays PLC. The H devices are original designs protected by registration in many countries. All rights are reserved.