Sr. Data Engineer (Operations AI)

What you'll work on

• Collaborate with cross-functional teams to understand and address Navy operational challenges using data pipelines and analytics.
• Design, develop, and implement data pipelines and analytics for naval applications.
• Perform exploratory data analysis, algorithm development, and testing.
• Normalize and structure data to common standards for interoperability.
• Work with multiple data formats, including CSV, JSON, XML, Parquet, and ORC.
• Develop and deploy data pipelines and analytics in real-world operational environments.
• Deploy, monitor, and optimize data pipelines to ensure high performance and reliability.
• Implement event streaming pipelines using Apache Kafka, AWS Kinesis, RabbitMQ, or ZeroMQ.
• Utilize distributed computing platforms such as AWS Lambda, Dask, or Spark.
• Leverage cloud-native tools including AWS S3, RDS, EFS, SNS, and SQS.
• Utilize data pipeline frameworks such as Airbyte, Apache Airflow, dbt, Apache Iceberg, and Snowflake.
• Work with GIS data using ArcGIS, PostGIS, and related tooling.
• Implement containerized environments using Docker or Kubernetes.
• Apply cybersecurity principles in the context of secure DoD data applications.
• Communicate findings and engineering solutions effectively with technical and mission stakeholders.

What we're looking for

Not Specified