mardi 27 décembre 2016

Web interface for spark jobs

I am new to Spark and trying to figure out best way to develop a mechanism which has a web/mobile interface that can trigger spark jobs on a remote cluster. Basically having spark jobs available as a service. Any thoughts on Livy, spark-jobserver? Architectural trade offs?

Example scenario : Click a submit button on a custom web/mobile app which runs a SparkSQL job on a remote cluster and then returns the result to the app which then gets displayed on the web/mobile UI.

Any thoughts?




Aucun commentaire:

Enregistrer un commentaire