Sure, but like I said Handgun.It's not generally illegal to carry a shotgun or AK in public.
Also, though it is not illegal to walk down the street with a long gun you are more then likely going to get a visit from law enforcement if you are not part of some type of organized march or don't have a city permit. At least where I live in the highly populated suburbs!If you don't have a CHL it is illegal to walk down your neighborhood block with a handgun let alone a city park.
Like I said it doesn’t mean you can’t do it but someone will probably call the police if you are walking in a city park or in a neighborhood.