Hardness and tractability for structured numerical problems