Robustness, generality and efficiency of optimization algorithms for practical applications