Career with Digital Minds

Sr Data Engineer

Location: Chicago, IL (Remote)
Rate: $60 C2C
Requirements:

snowflake , postgresql, python pyspark

We are looking for a highly skilled Data Engineer to join our team. The ideal candidate will have a strong background in building and optimizing data pipelines, designing scalable data systems, and working with large data sets. This role requires technical expertise, attention to detail, and the ability to collaborate across multiple teams.

Key Responsibilities:
  • Design, develop, and maintain scalable and efficient data pipelines.
  • Build and optimize data workflows, ensuring accuracy, quality, and consistency across systems.
  • Collaborate with cross-functional teams to define data requirements and deliver reliable solutions.
  • Implement data models, ETL processes, and data integration strategies.
  • Ensure compliance with data governance and security standards.
  • Troubleshoot, optimize, and maintain data infrastructure for high performance.
  • Required Skills & Qualifications
  • Strong proficiency in SQL and Python.
  • Hands-on experience with ETL frameworks and building complex data systems.
  • Familiarity with cloud platforms such as AWS (preferred).
  • Solid understanding of data warehousing concepts.
  • Strong analytical and problem-solving skills with high attention to detail.
  • Ability to work collaboratively in cross-functional environments.
Preferred / Nice-to-Have Skills:
  • Experience with big data technologies such as Hadoop or Apache Spark.
  • Knowledge of data lake architectures and advanced data modeling techniques.
  • Exposure to DevOps practices for data pipeline automation and monitoring.

Lead Data Engineer

Location: Houston, TX- On-site (local candidates only)
Rate: $70 C2C
Job Description:

We are seeking a Lead Data Engineer with deep AWS expertise to guide the design, development, and optimization of our enterprise-scale data pipelines and products. In this role, you will not only contribute technically but also provide leadership to a team of data engineers, partner closely with data architects, and play a key role in planning, estimating, and resourcing major data initiatives. You’ll work on high-impact projects that integrate and transform large volumes of data from multiple enterprise systems into reliable, accessible, and high-quality data products that power analytics, reporting, and decision-making across the organization. 

Key Responsibilities:
  • Lead the end-to-end design, development, and optimization of scalable data pipelines and products on AWS, leveraging services such as S3, Glue, Redshift, Athena, EMR, and Lambda.
  • Provide day-to-day technical leadership and mentorship to a team of data engineers—setting coding standards, reviewing pull requests, and fostering a culture of engineering excellence.
  • Partner with data architects to define target data models, integration patterns, and platform roadmaps that align with AECOM’s enterprise data strategy.
  • Own project planning, estimation, resourcing, and sprint management for major data initiatives, ensuring on-time, on-budget delivery.
  • Implement robust ELT/ETL frameworks, including orchestration (e.g., Airflow or AWS Step Functions), automated testing, and CI/CD pipelines to enable rapid, reliable deployments.
  • Champion data quality, governance, and security; establish monitoring, alerting, and incident-response processes that keep data products highly available and trustworthy.
  • Optimize performance and cost across storage, compute, and network layers; conduct periodic architecture reviews and tuning exercises.
  • Collaborate with analytics, reporting, and business teams to translate requirements into reliable, production-ready data assets that power decision-making at scale.
  • Stay current with the AWS ecosystem and industry best practices, continuously evaluating new services and technologies to enhance Customer’s data platform.
  • Provide clear, concise communication to stakeholders at all levels, articulating trade-offs, risks, and recommendations in business-friendly language.