Combine pumpkin puree, brown sugar, pumpkin spice, and milk into a large mason jar. Put the lid on and shake until milk bubbles form.
Remove lid and microwave for 25-35 seconds.
Put lid on and shake until milk bubbles form.
Pour ½ cup of coffee into each mug. Divide up milk mixture between the two mugs.
Top with whipped cream if desired.