Software Engineer Senior - GCP Data Engineer -Big Data

Key Responsibilities: Design, build, and deploy scalable and robust data pipelines using Google Cloud Dataflow. Harness the capabilities of BigQuery for data analytics, ensuring optimized performance and cost efficiency. Manage workflow orchestration and automation using Cloud Composer. Monitor, troubleshoot, and optimize data pipelines for performance, ensuring data quality and integrity. Stay updated with GCP's latest features and best practices to ensure the company's data infrastructure remains cutting-edge. Document data architectures, processes, and data lineage for transparency and maintainability.

Qualifications: 3-4 years of experience as a data engineer with significant exposure to the Google Cloud Platform. Strong expertise in GCP tools, particularly Dataflow, BigQuery, and Cloud Composer. Strong GCP Dataflow, Java/Python & beam skills, Lead experience for delivery streams. Experience in working with streaming / messaging systems like Kafka, Pulsar, GCP PubSub, RabbitMQ and similar tools. Including connectors for systems like Cassandra. Familiarity with other GCP services such as Cloud Storage, and Dataproc. Strong analytical and problem-solving skills. Familiarity with other cloud platforms (e.g., AWS, Azure) is a plus. Excellent communication skills, both written and verbal. Bachelor's degree in Computer Science, Engineering, or a related field.

Additional Requirements: Demonstrated ability to work in a fast-paced environment, managing multiple projects simultaneously. Commitment to continuous learning and adapting to the rapidly evolving data landscape. Proven ability to collaborate effectively with both technical and non-technical stakeholders.