From my limited understanding, you should get rid of the post since the birds you want don't actually use it. Also make sure the hole is the right size for the birds you want to nest there. Lastly, you should break up house sparrow nests if it looks like they are building one.
