Close the server, restart it, and now my memory usage is running down at around 50-80MB. Guess I'll let it go for a while and see if the amount creeps up over time. If so, there's a memory leak in there somewhere, but I don't have a clue where it might actually be at.
At least I got a good test result from it, and it shows that my ports are forwarded properly now, and my firewall exceptions are all working as intended. Spriggys connected to my system and sent and received information properly, and that was the most important thing that I was wanting to confirm. Program glitches can be ironed out anytime now; I just needed to see if I could open that remote connection and send/receive data properly, and I'm happy to report that that is a success, at least. :)