After Jenkins successfully shutdown, my Gitlab CE is now using port 8080 so I need to shut it down also to make way for my WildFly Application Server.  Command issued to shutdown Gitlab CE are as follows:

1.  su as root

2. At command prompt: gitlab-ctl stop

Referred from here: https://docs.gitlab.com/omnibus/maintenance/

That's all folks!