Fishing Biloxi MS

The wife and I are going to Biloxi in March and I would like to try some fishing down there. Does anyone know the best way to just go catch some fish without paying a small fortune for a charter boat?

Fishing Biloxi MS