How do I rename or delete an existing category?

Tap the Settings icon:

Select Categories:

Choose the category you want to change:

From here, you can change the name or colour, and hide or delete the category:

Only custom categories can be deleted. Built-in categories will instead be hidden.