If you fail to discharge planning conditions, it could make your permission invalid.
You could have to apply for planning permission again, with no guarantee of acceptance. Or you could end up with action against you, including but not limited to prosecution.