In a small bowl, combine the sugar substitute, cocoa and coffee. Add boiling water; stir until coffee and cocoa are dissolved. Stir in milk and vanilla. Cover and refrigerate for at least 1 hour.
Place the coffee mixture in a blender; add ice cream. Cover and process until smooth. Pour into mugs or glasses; garnish with whipped topping and cinnamon.