WaveAccess is an international results-driven company that provides high-quality custom software development services for hundreds of emerging and established companies globally. By supporting customers with talented software engineers and also vast experience in advanced technologies, WaveAccess builds innovative software solutions while minimizing development risks and costs.
Throughout its 21-year history, the company’s highly skilled specialists have implemented over 500 successful projects for market leaders, ambitious startups, and government institutions.
Currently, we are looking for a Data engineer (Java) to make the team even stronger.
Tech Stack: Java, Scala, Apache Spark, Clickhouse, HDFS, Apache Airflow, Apache Phoenix, Hbase, Postgresql, Hudi, Apache Kafka, Spring Framework
Required Skills and Experience:
- Knowledge of Java, Scala
- Linux console minimum
- Understanding and experience with Spark
- Basic knowledge of working with databases, confident knowledge of SQL
Nice to Have:
- Experience with Big Data, Zeppelin, Jupiter
- Experience in working with ClickHouse, HBase/Apache Phoenix or other NoSQL
- Experience in building and orchestrating ETL processes
- Experience with Apache Air flow
- Knowledge of Hadoop/HDFS
- Working with Parquet files
- Knowledge of Bash enough to correct scripts
- Ability to work with GitLab CI
- Experience with Spring Framework
- Minimal knowledge of Python
- English (sufficient to read tech documentation)
Responsibilities:
- Building, supporting ETL processes and solving various business tasks for processing large amounts of data using Spark and Java applications
- Optimization of data processing speed and system resource consumption
- Finding and eliminating the causes of errors, anomalies of the result
- Creating optimal SQL queries of medium complexity for analyzing large amounts of data according to business requirements
We offer:
- Various projects for international clients on modern technology stack
- Friendly team and enjoyable working environment
- Regular assessments and salary reviews Read more at wave-access.com