14.10 - How to remove a newer kernel while booted with the older kernel?

I have two kernels installed on my system. 3.16... and 3.19.3...I'm running Ubuntu 14.10 and it came with the 3.16...kernel. I decided to try the latest possible kernel (3.19.3...), but I sometimes get errors and the system feels unstable. I see no reason to keep this new kernel. Is there any issue I might run into if I choose to boot into the older kernel, and then remove the newer one using say, Synaptic? Will I run into issues once I reboot, or will Ubuntu just boot automatically into the older kernel with no fuss?

Any advice on the proper procedure and what methods to best achieve my goal would be appreciated. Thanks.