Business Intelligence Engineer

Responsibilities:

  • Implement and support big data tools and frameworks such as HDFS, YARN, and Impala.
  • Build and support streaming and data processing frameworks such as Kafka, Spark, Spark-Streaming, Cassandra.
  • Deliver real time and near-real-time data and applications to provide insights and analytics applications for our stakeholders.
  • Support the development of deployment automation and operational support strategies.
  • Assist in the development of a big data platform, using pipeline technologies such as Spark, Airflow and more to support a variety of requirements and applications.
  • Set the standards for warehouse and schema design in massively parallel processing engines such as Hadoop and Snowflake while collaborating with analysts and data scientist in the creation of efficient data models.
  • Build scalable ML/AI application with production scale.
  • Develop data monitoring framework to ensure highest data quality.

Qualifications:

  • 2+ years of work experience with ETL/ELT, data modeling, business intelligence or Machine Learning on Big Data Platform.
  • 2+ years of experience with big data ecosystems (Kafka, Cassandra, etc.).
  • Knowledge of at least one SQL language such as T-SQL, PL/SQL or SnowSQL.
  • Experience architecting, developing, and managing data warehouses on a terabyte or petabyte scale.
  • Solid experience in massively parallel processing & columnar databases (Hive, Impala, Cassandra, MongoDB, Snowflake, Kudu, etc).
  • Experience working with Real-Time streaming and batch processing and/or machine learning pipelines.
  • Experience with Python, Java and shell scripting.
  • Experience working in a Linux environment.

Desired Knowledge, Skills, and Abilities:

  • Deep understanding of advanced data warehousing concepts and track record of applying these concepts on the job.
  • Ability to manage numerous requests concurrently and strategically, prioritizing when necessary.
  • Good communication skills.
  • Dynamic team player.
  • A passion for technology.

Pluses:

Please note that these are desirable skills and are not required to apply for the position.

  • Experience with event processing frameworks or ML Frameworks.
  • Experience with Spark-ML or AzureML.
  • Experience in Lambda architecture.
  • Experience with CI/CD.
  • Familiar with Restful APIs.
  • Experience with Artifact Repositories.
  • Knowledge of the video game industry.

General Information

Press Inquiries

Tech Support

Menu