Start with the contract
Whatever the law says, the contract decides most of it. Look for the specification, the delivery dates, any statement that time is of the essence, the remedies for delay or defects, the rejection procedure and the notice requirements.
Notice provisions are where small businesses lose good claims. A contract requiring defects to be notified in writing within seven days, and goods rejected before use, is enforceable. Use the goods, fail to notify, and the right to reject may be gone.
Where the contract is silent, the statutory implied terms fill the gap: that goods are of satisfactory quality, fit for their particular purpose where the supplier knew it, and match their description. Those terms apply to business-to-business sales and cannot be excluded where the buyer deals on the seller's written standard terms and the exclusion would be unreasonable.
Rejecting goods and terminating
A right to reject is not automatic for every defect. The question is whether the breach is serious enough to entitle you to treat the contract as at an end — a repudiatory breach — or whether it gives a right to damages only. Late delivery may or may not cross that line, which is why time of the essence clauses exist.
If you do terminate, do it clearly and in writing, state the breach relied on, and do not carry on accepting deliveries or paying invoices. Conduct after the decision can waive the right you thought you had exercised.
If you need the goods and the supplier cannot deliver, you can buy elsewhere and claim the difference in price, provided you mitigate — that is, act promptly and reasonably rather than waiting to run up a bigger loss.
Proving and claiming the loss
The recoverable loss is normally the direct and foreseeable consequence of the breach: the cost of replacement, the difference in price, the cost of rework, lost profit on a specific contract that the supplier knew about.
Losses that are too remote are not recoverable. If you lost a contract because the goods were late, you need to show the supplier knew that contract was the purpose of the order. Tell suppliers what the goods are for, in writing, and the remoteness argument disappears.
Interest, storage costs and the cost of mitigation all have to be evidenced. A claim assembled from invoices, delivery notes and dated correspondence settles; an assertion of 'lost business' does not.
Setting up so it does not happen again
Buy on your own terms where you can, and keep a written record of the specification and the delivery date. A purchase order that references your terms, accepted in writing, is worth more than a phone call and a good relationship.
Consider a service level agreement with a credit mechanism for large or critical suppliers, and a step-in or second-source arrangement for anything the business cannot run without.
And read the termination clause before you sign. The suppliers who cause the most damage are rarely the ones who breach spectacularly; they are the ones whose contract makes leaving expensive.