Data Engineer
- Location: Maryland
- Job #: 1025
- Job Type: Permanent
- Job Category: Technology
Play a crucial role in designing, developing, and maintaining our data infrastructure and pipelines, ensuring the efficient and reliable flow of data from various sources to support our data-driven initiatives. Collaborate with cross-functional teams to understand data requirements and design efficient data integration and ETL pipelines. Develop, construct, test, and maintain architectures, such as databases and large-scale processing systems. Build and maintain data pipelines to transform, clean, and aggregate raw data from diverse sources into usable formats. Work with data scientists and analysts to provide them with the necessary data infrastructure to conduct analyses and build data-driven products.
- Proven experience as a Data Engineer or in a similar role, designing and implementing data pipelines.
- Proficiency in programming languages such as Python, Java, or Scala.
- Strong experience with data modeling, database design, and SQL development.
- Familiarity with big data technologies such as Hadoop, Spark, or Kafka.
- Knowledge of data governance and data cataloging tools.
- Experience with containerization and orchestration tools like Docker and Kubernetes