I restarted and it went back to the same state. Sometimes firestarter just freezes and crashes for no apparent reason. When I looked in services, I found there is a firestarter service, and when I disable it, the firewall works just fine. I suppose it could be a conflict with IP tables.
On a side note, the Service Confguration won't let me Stop the firestarter service. when I use:
[root@server ~]# service firestarter stop
Stopping the Firestarter firewall: [ OK ]
[root@server ~]# service firestarter status
Firestarter is stopped
It still shows up as running under the service configuration.