Inswing handle set