what are you doing? I hope its not "charging a lipo battery".
A resistor won't work, not because it will dissipate a lot of heat, but because the voltage drop across a resistor depends directly on the current through it. That means you'll only get the range of voltages you require for a small range of currents.
An easy option is a diode or two. These are a bit like resistors in that the voltage drop across them depends on the current through them, but differs in that the relationship is not linear. In the case of diodes, the voltage drop is essentially 0 at zero curry, but rises very rapidly to about 0.6V, and then far more slowly after that (up to 2 volts at very high currents). Series diodes are often a solution, but in your case it may not be.
Another option is a linear regulator. In your case you'd need a low dropout (LDO) regulator. This will also dissipate quite a bit of heat (essentially the same as a resistor) but has the benefit of producing the same output voltage under effectively all loads.
Another option is a switch mode regulator. These have the benefit of *not* departing so much Great. However they are significantly more complex, and in this case the difference in heat dissipation will not be great.