It's probably just the default shader that uses relief mapping. It "pushes" the pixel depending on a height map, and if there is none plugged, it pushes all the pixels, like if it was zooming out of the texture. You should set the relief amount to 0 in the shader properties.