ETL Developer - TS/SCI with Polygraph Jobs
$200,000 per year
Apply now (opens in a new tab)ETL Developer - TS/SCI with Polygraph Jobs
L5
$200,000 per year
Occupations
Data Warehousing SpecialistsGeographic Information Systems Technologists and TechniciansSoftware Developers- Design, develop and manage ETL workflows using Apache NiFi to support a geospatial visualization platform
- Learn the nuances of the existing NiFi system and the related AWS and PostgreSQL infrastructure in order to monitor and troubleshoot real time issues
- Obtain an understanding of existing NiFi flows with minimal support from others
- Develop new NiFi flows that adopt best practices of existing NiFi flows
- Take feedback on NiFi flows and develop requested changes
- Take direction and communicate status via a ticketing system
- Interface with analysts via email, chat, and in person meetings to comprehend future data flow needs and refine general requirements into specific actions
- Interface with a development cycle using a local development environment of containerized infrastructure and version control via Git and NiFi Registry
- Gain competency in geospatial database design and employ best practices for table creation, indexing, and unique constraints
- Take feedback from analysts on nuances to support application data layers
- Programmatically manipulate and transform data from multiple sources
- Query and analyze large datasets using SQLRetrieve and process data from external systems via APIsSupport data quality, integrity, and performance optimization efforts
- Understand Python and data science frameworks while differentiating between experimental prototypes and enterprise level software requirements
- Develop Python in support of data science related efforts or ETL prototypes
- Creativity to experiment and recommend best practice coding improvements
- Drive to adopt and recommend AI into development processes
- Ability to design and develop custom NiFi processors using Java
- Experience with AWS cloud services for data ingestion and processing
- Strong experience with PostgreSQL for data management
- Hands-on experience with Apache Airflow
- Hands-on experience with Apache NiFiHands-on experience with NiFi registry and GitHands-on experience with Git and repository actions and pull requests
- Hands-on experience in Python for data manipulation and API interfacing
- Experience working with geospatial data and related tool
- Understanding of basic data science concepts and tools
Level
SeniorL5
Salary
$200,000 per year
Location
McLean, VA
Occupation
Data Warehousing Specialists
Industry
Computer Systems Design Services
Posted
yesterday
To get sharper similar jobs, create your profile using the link below.