Nevermind, turns out I was using the cpu engine, which apparently doesn't fully support hdr.
I attached an sbs with 2 linear blending setups. 1 using hdr, and another I usually use, working in 16 bit (non-hdr)
Some things I noticed with the hdr method, are that even when you set your graph to an hdr format, a lot of noises will still generate as regular 16 bit, so keep in mind to set the bitdepth of the next node to relative to parent or absolute.
And for levels nodes, make sure you set "intermediary clamp" to "passthrough".