Job Description

Job Title: ETL Automation Specialist
Location: Columbia, SC

Duration: 12 Months

Pay Rate: $55 – $60/hour

Candidate must be a CURRENT South Carolina resident. No relocation allowed.

Job Description:
The ETL Automation Specialist will focus on developing robust automated testing frameworks for data pipelines and transformations. This role will support continuous improvement efforts within enterprise-scale data systems.

Daily Responsibilities:

• Develop scalable, reusable Python-based frameworks for automated ETL testing.
• Automate test execution within CI/CD pipelines to support DevOps practices.
• Perform data quality validation using SQL and Python-based tools.
• Conduct performance and load testing on data pipelines.
• Collaborate with DevOps engineers to optimize test automation architecture.
• Create clear, actionable defect reports and work closely with developers for issue resolution.
• Utilize Git, Jenkins, Azure DevOps, or equivalent tools for version control and pipeline management.

Required Skills:

• 5+ years ETL and data pipeline testing experience.
• 3+ years building Python-based automation frameworks.
• Strong SQL scripting skills (SQL Server, Oracle).
• Experience integrating tests into CI/CD environments.

Preferred Skills:

• Experience with Docker, Kubernetes, or containerized data environments.
• Familiarity with Airflow or other orchestration platforms.
• Healthcare or Medicaid project experience is preferred.

Job Tags

Similar Jobs