Job Description / Skills Required
Aera is looking for a Big Data Engineer that will work on the collecting, storing, processing, and analyzing of huge sets of data.
The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them.
You will also be responsible for integrating them with the architecture used across the company.
The Challenge Ahead
Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities;
Implementing ETL processes and developing complex SQLs;
Monitoring performance and advising any necessary infrastructure changes;
Experience and core strength in Java and web technologies;
Experience with building stream-processing systems, using solutions such as Kafka-Streaming or Spark or Spark-Streaming a big plus;
Experience with developing ETL processes and data pipelines;
Experience with integration of data from multiple data sources;
Proficiency with complex SQL development;
Proficiency with NoSQL databases, such as HBase, Cassandra, MongoDB;
Proficiency with Hadoop v2, MapReduce, HDFS;
Knowledge of various ETL techniques and frameworks, such as Apache Flume, is a plus;
Ability to solve any ongoing issues with operating the Hadoop cluster in AWS;
Good understanding of distributed computing principles.
At Aera, we're on a mission to solve the biggest, most intractable challenges of enterprise software. We envision the rise of the Self-Driving Enterprise: a more autonomously functioning business with a central operating system that connects and orchestrates business operations. Our platform is increasingly used by the world's largest companies to identify and respond to market opportunities faster.
If you share our passion for building the next generation of enterprise software, and implementing it for the most sophisticated customers in the world, you’ve met your match. Headquartered in Mountain View, California, we're growing fast, with teams in San Francisco (California), Portland (Oregon), Bucharest and Cluj-Napoca (Romania), Paris (France), Munich (Germany), London (UK), and Pune (India). So join us, and let’s build this!