Create Services

linkaiyi
Follow

Your .service file should look like this:

[Unit]
Description=Spark service

[Service]
ExecStart=/path/to/spark/sbin/start-all.sh

[Install]
WantedBy=multi-user.target

Now do a few more steps to enable and use the .service file:

Place it in /lib/systemd/system folder with say a name of myfirst.service

Make that your script executable with:

chmod u+x /path/to/spark/sbin/start-all.sh

Start it:

sudo systemctl start myfirst

Enable it to run at boot:

sudo systemctl enable myfirst

Stop it:

sudo systemctl stop myfirst

Notes:

You don’t need to launch Spark with sudo in your service, as the default service user is already root.

Look at the links below for more systemd options.

UPDATE

Now what we have above is just rudimentary, here is a complete setup for spark:

[Unit]
Description=Apache Spark Master and Slave Servers
After=network.target
After=systemd-user-sessions.service
After=network-online.target

[Service]
User=spark
Type=forking
ExecStart=/opt/spark-1.6.1-bin-hadoop2.6/sbin/start-all.sh
ExecStop=/opt/spark-1.6.1-bin-hadoop2.6/sbin/stop-all.sh
TimeoutSec=30
Restart=on-failure
RestartSec=30
StartLimitInterval=350
StartLimitBurst=10

[Install]
WantedBy=multi-user.target

To setup the service:

sudo systemctl start spark.service
sudo systemctl stop spark.service
sudo systemctl enable spark.service
Object has 0 attachments

Was this article helpful?

This article is viewed 63 times!

Recent Viewed Articles

0 Comments

Leave a Comment

Support