DATA ENGINEER

The Data Engineer provides expertise in extracting data from multiple sources, transforming it into a usable form, and loading into data stores for use by analysts to conduct defensive cyberspace operations. The Data Engineer designs and implements data ingest and egress interfaces across data pipeline(s) at echelon and automates data collection and processing. In conjunction with the Analytic Support Officer and Analysts, the Data Engineer designs, implements, and enforces a standardized data schema to ensure data is transportable across data pipeline(s) at echelon for analysis and can be enriched with other standardized data feeds. Ensures optimal placement and migration of data between services for real-time ingest, short-term storage, and long-term storage. Assists in exploratory data analysis and visualizations to improve data reliability, efficiency, and quality.

PIPELINE: FUNDAMENTALS

1. Introduction to Relational Databases (RDMS)

2. Databases and SQL for Data Science with Python

3. Python Project for Data Engineering

4. Python for Data Science, AI & Development

5. ETL and Data Pipelines with Shell, Airflow, and Kafka

6. Elasticsearch Engineer

7. Security Onion 2: Detection Engineering and Analysis In-Depth

8. SANS SEC555: SIEM with Tactical Analytics

9. Data Engineering 101

PIPELINE: BASIC JQR

1. JQR-DCO-BASIC-DATA_ENGINEER-MOD4-GT3-V1-FY24

2. Basic DE JQR Module 4 GT4 - TFH

3. JQR-DCO-BASIC-DATA ENGINEER-MODULE 1-V2-11/28/22

4. JQR-DCO-BASIC-DATA ENGINEER-MODULE 2-V2-11/28/22

5. JQR-DCO-BASIC-DATA ENGINEER-MODULE 3-V2-11/28/22

6. JQR-DCO-BASIC-DATA ENGINEER-MODULE 5-V2-11/28/22