Big Data Engineer

Company: Acxiom
Location: Idaho Falls
Posted on: June 24, 2022

Job Description:

As a Big Data Engineer, you will assist leadership for projects related to Big Data technologies and software development support for client projects. You will help with migrating our current Big Data clusters to the latest releases, and implement High-Availability and High-performance features. You will help with deploying, optimizing and supporting new Big Data clusters on the Public Cloud.

**What you will do:**

- Responsible for implementation and ongoing administration of Hadoop infrastructure in Cloudera

- Deploy, manage, maintain, and optimize Big-Data deployments to Public Cloud using Databricks, Qubole etc.
- Optimize query performance and tuning for jobs running on Spark, Impala, and Hive
- Automate repetitive tasks by performing hands-on programming with Perl, Bash, and/or Python
- Provide Operational Support and maximize Service availability by monitoring, troubleshooting and resolving issues

**What Do you have?**

- 3+ years of Big Data Administration experience

- 3+ years developing in data warehouses or digital analytics
- 2+ years of hands-on Scripting skills in Perl, Python, Bash Shell
- Knowledge of Hadoop based data manipulation/storage technologies such as HDFS, MapReduce, Yarn, HBASE, HIVE, Pig, Impala and Sentry
- Experience in capacity planning, cluster crafting and deployment, troubleshooting and performance tuning
- Great operational expertise such as good troubleshooting skills, understanding of system's capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks
- Experience in Hadoop cluster migrations or upgrades
- Strong Linux/SAN administration skills and RDBMS/ETL knowledge
- Experience in Cloudera and/or MapR versions along with Monitoring/Alerting tools (Nagios, Ganglia, Zenoss , Cloudera Manager)
- Excellent verbal and written communication skills
- Bachelor's degree in related field of study, or equivalent experience

**What will set you apart?**

- Excellent working knowledge of Linux Systems on VMWare

- Automation using Chef and/or Ansible
- Strong Big-Data experience with Public Cloud deployments and support
- Quick learner with strong aptitude for solving problems

**Travel:**

Travel Required 5%

**PRIMARY LOCATION CITY/STATE:**

Homebased - Conway, Arkansas

Acxiom is an affirmative action and equal opportunity employer (AA/EOE/W/M/Vet/Disabled) and does not discriminate in recruiting, hiring, training, promotion or other employment of associates or the awarding of subcontracts because of a person's race, color, sex, age, religion, national origin, protected veteran, military status, physical or mental disability, sexual orientation, gender identity or expression, genetics or other protected status.

Keywords: Acxiom, Idaho Falls , Big Data Engineer, Engineering , Idaho Falls, Idaho