Quesscorp Singapore Pte Ltd
Singapore / Global
GET
The Big Jobsite
Singapore / Global
We are looking for a Mid-Level QA / Testing Automation Engineer with strong experience in Data Testing, Python, SQL, PySpark, and Big Data environments.
Key Responsibilities
Develop and maintain automated Python-based testing frameworks for data validation.
Perform data testing, reconciliation, and migration testing using Python and SQL.
Develop automated tests for PySpark transformations and data pipelines.
Perform regression, integration, scalability, and end-to-end pipeline testing.
Validate data across Bronze, Silver, and Gold layers.
Test Databricks workflows, schema evolution, data lineage, and data quality.
Identify defects and work with Data Engineers on root-cause analysis.
Requirements
5+ years of QA/Testing experience.
3+ years of Data Testing experience in Big Data, Hadoop, or Cloud Data Warehouse environments.
Proven experience transitioning from manual SQL checks to Python-based automation.
Experience with Python migration automation testing.
Strong SQL and PySpark skills.
Experience with Databricks is preferred.
Knowledge of Great Expectations/Pandera, DLT Expectations, Pytest-Spark, Git, or Unity Catalog is an advantage.
Databricks certification or ISTQB certification is a plus.
Python | PySpark | SQL | Data Testing | Test Automation | Databricks | Big Data | Hadoop | Data Validation | Migration Testing | Data Reconciliation
#J-18808-Ljbffr
Singapore / Global
Singapore / Global
Singapore / Global
Singapore / Global
Singapore / Global
Singapore / Global