“If a page goes down it’s usually a customer who lets support know. Sometimes we find the break in our manual QA or sales find out as they are searching for content. Other times we notice after we do a monthly metrics check because metrics went down.”
“We have custom alerts holistically across all carts, specific promotions, countries, etc.
When they broke it was hard to notice and it took a longer time to identify than we thought it would. We eventually heard things were down from customer support. We estimated the lost opportunity cost to be between $10k and $50k.”
“...cost per lead went up to over $1000. CPL should have been $100. We had to do a manual QA.”