LONG POST
You also have to take into consideration the ACTUAL weight of the boat vs the advertised weight. If you were to run them both over a set of scales, I think you would be amazed at the real difference.
There are a couple of differences in a 454 turning an engine to 4800 RPMs and a 305 turning a prop to 4800 RPMs...Horsepower and torque. A boat is at constant battle with friction and gravity. My Mom's deacon used to race as a hobby. I remember asking him why he spent so much time in the air going over waves. His answer was because it's faster than going through them. That takes care of the friction. as for gravity, the more horsepower you have to the prop, the faster you go. The faster you go, the less wetted surface you have dragging in the water (oops...there's that friction thing again)...The less wetted surface dragging in the water, the faster you go until you reach the physical point that the boat can not go any faster because it has no more power.
As for hull design, that plays a HUGE part in performance. Let's just say for the sake of argument your 454 in your 24 degree deep V BAJA puts out 300HP at 4800 RPMS. Now lets say a person in a 22' Ranger Bass Boat with a 300HP Suzuki outboard pulls up beside you. When he throttles his Ranger to whatever RPM will produce 300 HP, he is going to walk away from you because even if he was loaded down with enough gear an fish to equal the weight of your Baja, the hull is flatter at the transom and easier to push over the water.
If you want to experiment yourself, tuck your drive all the way in and lower your tabs all the way and see how that effects you boats handling and speed (CAREFUL ON THE SPEED!!!!YOU COULD EASILY BURY THE BOW AND FLIP THE BOAT!!!) Reset your tabs to half way up and 1/2 trim on the drive. You will notice a world of difference due to the change in hull configuration.
HTH