chimney where it joins the roof.  

I don't usually paint the inside of the chimney bottom because it is not seen. However, if the chimney is
very short and the bottom can be seen looking in the top of the chimney, then of course this should be painted.