Role: Google Cloud Platform Bigdata EngineerÂ
Client Location: Ashburn, VA or Irving, TX ( onsite)
Duration: 12+ Months
Required Qualifications
Expertise with the Technology stack available in the industry for data management, data ingestion, capture, processing and curation
ETL and Java development backgroundÂ
Experience in building high-performing data processing frameworks leveraging Google Cloud Platform
Experience in building data pipelines supporting both batch and real-time streams to enable data collection, storage, processing, transformation and aggregation.
Experience in utilizing Google Cloud Platform Services like Big Query, Composer, Dataflow, Pub-Sub, Cloud Monitoring
Experience in performing ETL and data engineering work by leveraging multiple google cloud components using Dataflow, Data Proc, BigQuery
Experience in scheduling like Airflow, Cloud Composer etc.
Experience in JIRA or any other Project Management Tools
Experience in CI/CD automation pipeline facilitating automated deployment and testing
Experience in bash shell scripts, UNIX utilities & UNIX Commands
Nice to have Qualifications
Strong understanding towards Kubernetes, Docker
Knowledge of Scrum/Agile development methodologies is a plus
Any experience with Spark, PySpark, or Kafka is a plus
Data analysis / Data mapping skills is a plus
Knowledge in data manipulation JSON and XML
Technical Skills:
Google Cloud Platform Services: DataFlow, BigQuery, Cloud Storage, DataProc, Airflow, Composer, Pub/Sub and Memorystore/Redis
Programming languages: Java, Python
Streaming ETL: Apache Beam, Kafka
Database: Teradata, BigQuery/BigTable
Job Description: Denkst du auch, dass es an der Zeit ist, Deutschlands Landes- und Bundesbehörden in die digitale Zukunft zu...
Apply For This JobJob Description Big Data Architect (Hadoop)(Accept OPT/CPT/H1) Location: Austin, TX (Initial Remote) Duration: Long Term We are seeking a highly...
Apply For This JobLa empresa Navantia S.A., S.M.E. realiza la siguiente Convocatoria para sus oficinas centrales de Madrid: 1 vacante de Técnico/a Superior...
Apply For This JobHi, Hope you are doing well ! I have an urgent requirement with one of my clients. Please find the job...
Apply For This JobTechnical Analyst – Mainframe and Big Data Experience Milton Keynes – Onsite 2/3 days a week 6 month contract Inside...
Apply For This JobSenior Engineer (Cloud Big Data / Scala / Spark) – Assistant Vice President Job ID: R0315046 Full/Part-Time: Full-time Regular/Temporary: Regular...
Apply For This Job