Clearlake Capital Group LP has struck a deal to buy Quest Software Inc. from Francisco Partners in the latest sign of private-equity firms’ voracious appetite for software.

The deal, expected to be announced as soon as Monday, values Quest at $5.4 billion including debt, according to people familiar with the matter.