Role overview
**Job Summary**
We are seeking a dynamic and innovative Data Engineer to join our data-driven team! In this role, you will be at the forefront of designing, developing, and maintaining robust data pipelines and architectures that empower insightful analytics and strategic decision-making. Your expertise will enable seamless integration of diverse data sources, optimize data workflows, and support advanced modeling initiatives. If you thrive in a fast-paced environment where your technical skills can make a tangible impact, this is the perfect opportunity to elevate your career in data engineering!
**Duties**
* Design, build, and maintain scalable data pipelines using ETL (Extract, Transform, Load) processes to support large-scale Big Data environments.
* Develop and optimize data models for data warehouses and data lakes utilizing tools such as Apache Hive, Spark, Azure Data Lake, and Hadoop.
* Implement efficient database designs and manage relational databases including Microsoft SQL Server, Oracle, and other SQL-based systems.
* Collaborate with cross-functional teams to gather requirements and translate them into technical solutions leveraging AWS cloud services like S3, Redshift, and Lambda.
* Integrate diverse data sources through RESTful APIs, Linked Data frameworks, and Informatica workflows to ensure comprehensive data availability.
* Write clean, efficient code in Java, Python, Bash (Unix shell), Shell Scripting, or VBA to automate workflows and perform complex analysis tasks.
* Support model training efforts by preparing datasets and ensuring data quality for machine learning initiatives.
* Conduct database design activities to enhance performance, scalability, and security of our data infrastructure.
* Participate in Agile development cycles to deliver iterative improvements rapidly while maintaining high standards of quality.
* Utilize analytics tools like Looker for visualization and reporting purposes to provide actionable insights across the organization.
**Skills**
* Extensive experience with cloud platforms such as AWS and Azure Data Lake for scalable storage solutions.
* Strong proficiency in Java, Python, Bash scripting, Shell scripting, and VBA for automation and development tasks.
* Deep understanding of Big Data technologies including Hadoop ecosystem components like Apache Hive and Spark.
* Proven ability to design and implement ETL workflows using tools such as Talend or Informatica.
* Expertise in SQL databases including Microsoft SQL Server and Oracle; solid knowledge of database design principles.
* Familiarity with Linked Data concepts for semantic web integration.
* Experience working with RESTful APIs for data integration purposes.
* Knowledge of Model training processes within machine learning pipelines is a plus.
* Strong analysis skills to interpret complex datasets effectively.
* Ability to work within Agile methodologies to deliver timely solutions in a collaborative environment.
* Excellent communication skills to articulate technical concepts clearly across teams. Join us if you're passionate about transforming raw data into powerful insights! We value innovation, collaboration, and a proactive mindset—all aimed at driving success through cutting-edge data engineering practices. This paid position offers an exciting chance to develop your expertise while contributing meaningfully to our organizational goals!
Job Type: Full-time
Pay: $108,261.20 - $130,379.07 per year
Work Location: In person