Put vanilla extract, pumpkin pie spice, and pumpkin puree in a sauce pan. Heat the mixture lightly and keep stirring so that it does not burn.
Add the matcha tea powder and water after a couple minutes of stirring and whisk to form a paste.
Add milk to the paste.
Continue stirring until it dissolves and then add your choice of sweetener. Stir to dissolve the sweetener.
You can use cinnamon and whipped cream to top up the latte in case you want to make it extra special.