Work Around
After I was able to get Xubuntu to successfully boot. I proceeded to install it. (for testing purpose I enabled the wireless radio from Bios and had the issue the freshly install Xubuntu 11.04 freeze at login screen (again) disabled it and everything worked fine (But no wireless)
Here is what I now did to fix the issue on my laptop. I did not have this issue on 10.10 mostly because that version of Kubuntu did not ship with the opensource broadcom drivers. I had to use the binary only driver from broadcom, hence the idea was to revert back to that setup.
first I installed the broadcom-sta-common (It provide a binary only closed source driver for broadcom)
sudo apt-get install broadcom-sta-common
Once installed, I edited the following file /etc/modprobe.d/broadcom-sta-common.conf
NB its always a good thing to backup before making any change to config file.
backup with this command
cp /etc/modprobe.d/broadcom-sta-common.conf /etc/modprobe.d/broadcom-sta-common.conf-orig
In case things gets jammed up and you want to revert, you can easily do so with
cp /etc/modprobe.d/broadcom-sta-common.conf-orig /etc/modprobe.d/broadcom-sta-common.conf
kdesudo kate /etc/modprobe.d/broadcom-sta-common.conf
NB gnome user should use gtksudo gedit in place of kdesudo kate (and if you are like me, you can use ever reliable vim 
Anyway I blacklisted the brcm80211 open source broadcom driver by adding this line to, /etc/modprobe.d/broadcom-sta-common.conf blacklist brcm80211 Before the last line. When done, everything looked like this
# wl module from Broadcom conflicts with ssb
# We must blacklist the following modules:
blacklist b44
blacklist b43legacy
blacklist b43
blacklist ssb
blacklist brcm80211
install wl /sbin/modprobe --ignore-install wl $CMDLINE_OPTS
I saved the file and then edited this file /etc/modules (again backup before editing)
cp /etc/modules /etc/modules-orig
By adding the module for the closed source (freedom hating but stable) broadcom driver so it is loaded at every system boot
I added lw to the end of /etc/modules so the file looks like this
# /etc/modules: kernel modules to load at boot time.
#
# This file contains the names of kernel modules that should be loaded
# at boot time, one per line. Lines beginning with "#" are ignored.
lp
lw
Saved the file, exited, and rebooted this time with the wireless on to test if the issue as been fixed. The laptop rebooted fine, no issue, but still no wireless. Then I started the Kubuntu additional driver tool or kdesudo jockey-kde (from commandline on Kubuntu) or gtksudo jockey (from commandline on Ubuntu) which searched and informed me I needed to activate some proprietary drivers to make the wireless card work properly. I enabled them, It did its magic and voilà the wireless card came on. I was able to enable and disable it without the system kernel panicing.
I rebooted my laptop and there was no problem at all, everything worked just like it did on 10.10.
I explained the same step to some dude on irc having similar problem and my solution worked for him so I decided to share in case anyone is having such problems.
I hope someone finds this useful.
