Only 20 of the 123 dogs temporarily adopted three weeks ago have been returned, despite temperatures returning to normal levels.