This individual should have strong SQL skills and be able to read and write complex SQL queries. They should also be familiar with Airflow and creating ETLs from scratch. A basic knowledge of Python is also required so they can deploy code in Airflow and also push code for metrics alerting, Amundsen and other internal data tooling changes.
Responsibilities:
- Build and maintain SQL repositories
- Perform quality checks on events and other data logs
- Clean up and maintain Airflow DAGs – including setting up complex dependencies, running backfills, investigating root causes of sequential failures etc
- Build and maintain Mode dashboards (knowing Mode is NOT a requirement for the job)
- Migrate existing dashboards/visualizations to Looker.
- Set up and investigate metric alerts using 3rd party tools such as Anamalo
- Data documentation and creating wikis to help others understand and use our data
- Create weekly metrics reports that summarize the state of the business
Required Skills:
- 5 plus years of overall experience
- Strong experience with SQL
- Basic knowledge with python
- Familiarity with Airflow
- A Bachelors degree or higher is required for this role.
