ETL Developer
$200,000 - $250,000 per year
Apply now (opens in a new tab)ETL Developer
L5
$200,000 - $250,000 per year
Occupations
Data Warehousing SpecialistsSoftware DevelopersGeographic Information Systems Technologists and Technicians- Design, develop and manage ETL workflows using Apache NiFi to support a geospatial visualization platform
- Learn the nuances of the existing NiFi system and the related AWS and PostgreSQL infrastructure in order to monitor and troubleshoot real time issues
- Obtain an understanding of existing NiFi flows with minimal support from others
- Develop new NiFi flows that adopt best practices of existing NiFi flows
- Take feedback on NiFi flows and develop requested changes
- Take direction and communicate status via a ticketing system
- Interface with analysts via email, chat, and in person meetings to comprehend future data flow needs and refine general requirements into specific actions
- Interface with a development cycle using a local development environment of containerized infrastructure and version control via Git and NiFi Registry
- Gain competency in geospatial database design and employ best practices for table creation, indexing, and unique constraints
- Take feedback from analysts on nuances to support application data layers
- Programmatically manipulate and transform data from multiple sources
- Query and analyze large datasets using SQLRetrieve and process data from external systems via APIsSupport data quality, integrity, and performance optimization efforts
- Understand Python and data science frameworks while differentiating between experimental prototypes and enterprise level software requirements
- Develop Python in support of data science related efforts or ETL prototypes
- Bachelor's degree with 8+ years of relevant experience, ORMaster's degree with 7+ years of experience, ORDoctorate with 6+ years of experience
- Degree in Computer Science, Systems Engineering, Geography, or a related technical field
- Active TS/SCI clearance with required polygraphU.S. Citizenship required
- Willingness to work onsite full-time
- Willingness to develop NiFi flows using existing best practicesStrong understanding of ETL concepts and best practicesStrong experience with databases for data management
- Proficiency in SQL for querying large datasets
- Experience with API integration and data retrieval
- Demonstrated experience with programmatic data manipulation
- Competency to rapidly adopt containerized development proficiencyCompetency to rapidly adopt AWS architecture proficiencyCompetency to rapidly adopt NiFi registry and Git for code management
- Creativity to experiment and recommend best practice coding improvements
- Drive to adopt and recommend AI into development processes
- Ability to design and develop custom NiFi processors using Java
- Experience with AWS cloud services for data ingestion and processing
- Strong experience with PostgreSQL for data management
- Hands-on experience with Apache Airflow
- Hands-on experience with Apache NiFiHands-on experience with NiFi registry and GitHands-on experience with Git and repository actions and pull requests
- Hands-on experience in Python for data manipulation and API interfacing
- Experience working with geospatial data and related tool
- Understanding of basic data science concepts and tools
Level
SeniorL5
Salary
$200,000 - $250,000 per year
Location
McLean, VA
Occupation
Data Warehousing Specialists
Industry
Computer Systems Design Services
Posted
today
To get sharper similar jobs, create your profile using the link below.