Big Data Engineer

Fecha de publicación: 28 Mayo 2021

IQ - Invest in Quality is a specialized Talent Attraction firm of IT profiles. 

Our client, is an important company focused on IT Services for different clients in the USA, If you are looking forward to relocate, this is your chance



·         Primary

o    Spark + Scala

o    Snowflake, HIVE, or similar

o    SQL

o    Azure, AWS

o    Kafka or similar

o    Qubole or Databricks

o    Python and Shell script

o    Java + Spring, Spring Cloud Data Flow

o    Linux

·         Secondary/Optional

o    Kubernetes


o    MDM concepts

o    Informatica ETL

o    Docker

o    Gitlab

·         Job Description;

Big Data Engineer - We are looking for a Software Engineer with expertise in a variety of Cloud and Big Data technologies to join our team in providing development and support across two large scale Data Warehousing offerings. Working as part of a global team you will contribute towards a new data warehouse solution utilizing a number of key technologies, such as Kubernetes/Snowflake/Kafka/etc, in a provider agnostic approach intended for operation across multiple cloud providers. Secondly, you will be providing support for a legacy data warehouse solution based on Spark/HIVE/Qubole and currently in operation on AWS.

Providing development, maintenance, & support for components across the Data Warehouse solutions requires you to have a good design sense, be able to quickly understand problems/questions from end-users, the ability to organize ideas/technical details and present your work clearly. Excellent Communication skills are therefore key along with experience working in an agile, self-driven, environment.

Technology skills we need;

·         5+ years experience in data warehouses

·         Degree in Computer Science or a related subject is required

·         Proficiency in Apache Spark (scala) and/or Java, SQL, databases such as Snowflake, and data warehousing concepts

·         Hands on experience with AWS|Azure, Kafka, Kubernetes, Python, Shell Script, and Linux

·         Working experience of Qubole or similar, Informatica, HADOOP, Docker, Gitlab, concepts around MDM are optional


Virginia, USA