Can't delete last row from table

I have a web service with Address and Phone lists, for which I created Basic Updateable Table providers. I have add row and remove row buttons in the table. On page load, I get saved data and pre-load the tables. I can add rows and delete rows from the table and it works fine (input to web service are the number of rows visible on the screen), except when I try to delete last row from the table, on which I get the last row in the input to web service even after deletion.

How do I get this working, am I missing a setting somewhere?