Data Engineer
Location: Atlanta, Georgia US
Notice
Job Number: 33544
Workplace Type: On-site
Employment Type: Full Time Associate
Position Title: Data Engineer II
External Description:
Randstad is hiring for a Sr. Data Engineer. The Sr. Data Engineer will work on collecting, storing, processing, and analyzing huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company. Because we work on the cutting edge of a lot of technologies, this job requires a creative problem solver, resourced in getting things done, and productive working independently or collaboratively.
What you get to do:
- Data - Analysis, Modeling, Architecture, etc.: Independently completes work with minimal supervision and guides others. Gather and process raw data at scale. Defining data retention policies. Work closely with our data science team (ad hoc analysis of the data). Acquire data from primary or secondary sources and maintain databases/systems. Create data sets and tables to store data. Make and test database schema changes when needed. Identify user needs to create and administer the data lake. Ingest and move data between databases that includes relational and no-SQL databases like Oracle, SQL Server, MongoDB, Elastic Search, Google Bigquery etc. Implement security measures by encrypting sensitive data
- ETL Development: Independently completes work with minimal supervision, guides others. Build and implement ETL processes. Modify ETL jobs to improve performance and efficiency
- Support: Troubleshoot high complexity problems and guide others
- Team: Guides Others. Work closely with management to prioritize business and information needs.
What you need to bring:
- 4 Year / Bachelor’s Degree in Computer Science, Statistics, Applied Mathematics or equivalent
- 5+ years of experience building and managing scalable, secure and reliable ETL data pipelines using ETL tools such as Talend, Pentaho, Informatica, Apache Airflow
- 2+ years of experience working with cloud technologies such as Google cloud, AWS, Microsoft Azure etc.
- 5+ years of development experience in Java or Python
- 5+ years of experience working with relational and No-SQL databases (Oracle, SQL Server, Elasticsearch, MongoDB, Cassandra etc)
- 5+ years of experience working on distributed/big data frameworks such as Spark, Hadoop, Kafka, Hive
- Experience with or knowledge of Agile software development methodologies (SCRUM, Kanban etc)
- Preferred skills - API development, CICD, DevOps, Google Bigquery, Google Cloud Composer
- Strong written and verbal communication skills
- Strong presentation skills
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
At Randstad, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please just let us know.
City:
State:
Community / Marketing Title: Data Engineer
Company Profile:
EEO Employer Verbiage:
EEO Employer Verbiage Displays here
Location_formattedLocationLong: Atlanta, Georgia US