Spark Streaming Architect
Remote Work
Job Description:
Technical Architect – Spark Streaming Architect (Postgres SQL, Kafka)
Location : Remote
- 10 +years Design and implement efficient data handling system based off Postgres or Spark tech stack.
- Experience investigating/troubleshooting & resolving PostgreSQL performance issues, SQL query tuning and optimization.
- Experience in Database Administration, specifically in PostgreSQL.
- Perform and oversee tasks such as writing scripts, calling APIs, and writing SQL queries.
- Implement data stores that support the scalable processing and storage of our high-frequency data.
- Hands-on experience with data cleaning, visualization, and reporting
- At least 4 years of relevant experience with real-time data stream platforms such as Kafka and Spark Streaming
- Experience working in an agile environment.
- Familiarity with the Hadoop ecosystem
- Experience with platforms such as MapReduce, Spark, Hive
- Experience with AWS is required.
- Excellent analytical and problem-solving skills
Excellent communication and interpersonal skills
Key Skills:
- "Spark Streaming" and "Kafka" and "Scala" and "PostgreSQL" and "Hadoop"