Big Data Engineer | Onsite | Santa Clara, CA, United States

by

Big Data Engineer | Onsite | Santa Clara, CA, United States

We are excited to announce an opening for a Big Data Engineer in Santa Clara, CA. This is an onsite position requiring locals to work five days a week. We welcome candidates with any visa status who have a strong background in big data technologies and architecture.

Position Details:

  • Location: Santa Clara, CA (Onsite 5 days/week)
  • Experience Required: 10+ years
  • Visa Status: Any

Job Description: As a Principal Big Data Engineer, you will be an integral member of our data ingestion and processing platform team. Your responsibilities will include architecture, design, and development of scalable data solutions. You should possess the ability to adapt to conventional big data frameworks and tools, addressing the unique use cases required by the project.

Key Responsibilities:

  • Collaborate with research and development teams and data scientists to identify bottlenecks in data processing and resolve them.
  • Design and implement various architectural models for scalable data processing and storage.
  • Build tools for effective data ingestion from multiple heterogeneous sources.

Must-Have Skills:

  • Data Pipeline Development: Proven experience in designing and implementing data pipelines.
  • SQL and Python Proficiency: Strong skills in SQL and Python for data manipulation.
  • Apache Beam: Experience in building data processing workflows with Apache Beam.
  • Google Kubernetes Engine (GKE): Familiarity with GKE for managing containerized applications.
  • Google Cloud Platform (GCP): Experience with GCP services for data processing and storage.
  • Apache Airflow: Knowledge of orchestration tools like Airflow for scheduling data workflows.
  • BigQuery (BQ): Expertise in using BigQuery for data analysis and querying.
  • DataFlow: Experience with DataFlow for managing data processing pipelines.
  • Java: Strong programming skills in Java.

How to Apply: If you meet the qualifications and are interested in this opportunity, please send your updated resume to Veena Verma at veena.verma@snowrelic.com.