simply enable AO = screen space ambient occlusion
I think, you can also add shadows by i.e. adding a directional light (scene > new light, select light and switch it from omni to directional, check "cast shadows"
I did a quick test scene, and it is working for me, but maybe I didn´t understand your problem correctly
if you want to remove the lighting effect from the hdri, simply dim it or hide it