Increased regularization does not necessarily decrease the number of support vectors

Although neural networks seem to be getting all the attention in machine learning these days, support vector machines (SVMs) are still quite useful in some situations. For example, if you want a classifier to work on a wearable/implantable device that consumes very little energy, SVMs-on-a-chip are currently probably your best option. If you are making … More Increased regularization does not necessarily decrease the number of support vectors