Good for you on the pushups!
I definitely would do a bodyweight set or with a broomstick before you try a new exercise. It's good to just get the feeling of the exercise before you add weight. I actually prefer doing my squats/deads with the big Oly bar instead of smaller ones. Feels better
