Data Engineer / Pipeline Developer

NO C2C, ONLY W2 

Location: Remote 

The Contractor shall undertake the following task: 

• Develop data source pipelines using data provided by the Data Analytics Division 
• Such data may come from DOE, other Federal Agencies, or commercial sources 
• Coordinate the project using Agile SAFe methodology to allow some Data Analytics staff to shadow and/or co-create all development work products 
• Use standardized Azure Synapse pipelines and data management practices 
• Support may be required to clean data or locate additional sources 
• Create an Azure Machine Learning notebook template for each of the pipelines 
• Integrate Azure Synapse with Power BI to permit data visualizations using the data sources 
• Establish authentication process for end users (both HQ & Field Sites) to view visualized dashboards 
• Document the processes and workstreams 

Specific Knowledge and Skills 

• Expert in Synapse Analytics 
• Advanced skills in Python  
• Advanced skills in Microsoft SQL Sever