I am new to Spark and trying to figure out best way to develop a mechanism which has a web/mobile interface that can trigger spark jobs on a remote cluster. Basically having spark jobs available as a service. Any thoughts on Livy, spark-jobserver? Architectural trade offs?
Example scenario : Click a submit button on a custom web/mobile app which runs a SparkSQL job on a remote cluster and then returns the result to the app which then gets displayed on the web/mobile UI.
Any thoughts?
Aucun commentaire:
Enregistrer un commentaire