Yes it should be deleted. There really is no point to it. The only problem is we might end up having to remove each individual page from the category before deleting the category page in order for it to fully be removed.
I can definitely start doing it, but I think it'll be the sort of thing that takes a few days of work to get done. If you see any pages in the category in the next few days just remove them individually as you go about your editing, just for that little bit of extra help.
I would help more, but my Internet connection is very, very slow. It takes so long just to remove one page from the category. I'll try do some. By the way, was it unregistered users that created this category and added pages to it?
Interesting experiment indeed. Removing pages from categories is a relatively simple task for bots, but I have no experience with them, so I can't help you with that or give you permission to do it without Juicestain's consent.
Mojo you really don't need my "permission" to advise other users to do things...
And Spike yes that is a good idea. I myself would like to learn about using/making bots, I've just never had the time. If you want to experiment, go ahead. Let me know how it goes and we'll try to get it into the Wiki.