Yes, gravity is pulling the object down. When we multiply the force of gravity with the mass on an object, we get its weight. When the weight of an object is greater than the buoyancy, it is able to move downwards. This means that the forces acting on an object are unbalanced.