To permanently remove a firewall:
Go to the Networks → Firewall section.
Click on the three dots next to the desired firewall.
Click Delete Rule Group.
Confirm deletion.
The firewall and the rules created in it will be deleted and will no longer apply to the added services.