Saturday will avoid the locals going to work, so that's a plus. And the timing seems ok too.
But don't expect a peaceful, country like drive. Traffic around Balto. and DC is horrible any day, any time. One of the worst non-accident, non-construction backups I've ever been in was at the "mixing bowl" one Sunday aftrenoon. Traffic was backed up almost to I-66. Incredible. I kept looking for the accident, looking for the construction--and there wasn't any.