Skip to content

bylexus/fparse

Repository files navigation

fparser

A JavaScript Formula Parser

Master Build Develop Build

fparser provides a Formula class that parses strings containing mathematical formulas (e.g. x*sin(PI*x/2)) into an evaluationable object. One can then provide values for all unknown variables / functions and evaluate a numeric value from the formula.

For an example application, see https://fparser.alexi.ch/.

Features

Parses a mathematical formula from a string. Known expressions:

  • Numbers in the form [-]digits[.digits], e.g. "-133.2945"
  • Numbers in scientific notation: e.g. "1.23e5", "1.5E-10", "-2.5e+3"
  • simple operators: '+','-','*','/', '^' expanded in correct order
  • logical operators: '<','<=','>','>=', '=', '!=', which evaluate to 1 or 0. Useful for implementing conditional logic
  • parentheses '(', ')' for grouping (e.g. "5*(3+2)")
  • all JavaScript Math object functions (e.g. "sin(3.14)")
  • all JavaScript Math constants like PI, E
  • the use of own functions
  • the use of variables (like 'x', 'myVar')
  • the use of named variables with optional brackets (like '2*myVar' or '2*[myVar]')
  • the use of strings as function arguments (like 'concat("Size: ", 2, " mm")')
  • the use of strings as variables (like 'concat("Size: ", 2, " ", [unit])')
  • the use of path named variables and functions (like '2*[myVar.property.innerProperty]')
  • memoization: store already evaluated results for faster re-calcs
  • use it in Web pages, as ES6 module or as NodeJS module
  • Example:
    -1*(sin(2^x)/(PI*x))*cos(x)

Breaking Changes in v4.0

Version 4.0 introduces significant improvements to the parser architecture, but includes some breaking changes. If you're upgrading from v3.x, please review these changes:

Syntax Changes

Implicit multiplication is no longer supported. You must now use explicit * operators:

Old Syntax (v3.x) New Syntax (v4.0) Status
2x 2*x ❌ No longer supported
2xy 2*x*y ❌ No longer supported
-3x -3*x ❌ No longer supported
3x^2 3*x^2 ❌ No longer supported
[myVar] myVar or [myVar] âś… Both work (brackets optional)
PI*x PI*x âś… Still works

Migration: Update all formulas to use explicit multiplication operators (*).

Semantic Changes

Power operator (^) is now right-associative (following mathematical convention):

Expression Old Behavior (v3.x) New Behavior (v4.0)
2^3^2 Left-associative: (2^3)^2 = 64 Right-associative: 2^(3^2) = 512
2^2^3 (2^2)^3 = 64 2^(2^3) = 256

If you have formulas with chained power operators and need the old behavior, add explicit parentheses: (2^3)^2.

Removed Public Methods

The following internal methods are no longer available as they were only used by the old parser:

  • isOperator(char) - Only used internally by old state machine parser
  • isOperatorExpr(expr) - Only used internally by old state machine parser
  • splitFunctionParams(str) - Parser now handles function arguments directly

Benefits

These changes enable a cleaner, more maintainable parser with better error messages and easier extensibility. Multi-character variables no longer require brackets, making formulas more readable.

Usage

Include as ES module directly in your web page:

<!-- Within a web page: Load the fparser library: -->
<script type="module">
	import Formula from "dist/fparser.js";
	const f = new Formula('x+3');
</script>

Use CommonJS / global syntax for non-module environments:

<script src="dist/fparser.umd.cjs"></script>
<script>
	const f = new Formula('x+3');
</script>

Install it from npmjs.org:

# Install it using npm:
$ npm install --save fparser

Then use as ES6 module (recommended):

import Formula from 'fparser';

or use it as UMD module:

const Formula = require('fparser');

... and finally use it:

// 1. Create a Formula object instance by passing a formula string:
const fObj = new Formula('2^x');

// 2. evaluate the formula, delivering a value object for each unknown entity:
let result = fObj.evaluate({ x: 3 }); // result = 8

// or deliver multiple value objects to return multiple results:
let results = fObj.evaluate([{ x: 2 }, { x: 4 }, { x: 8 }]); // results = [4,16,256]

// You can also directly evaluate a value if you only need a one-shot result:
let result = Formula.calc('2^x', { x: 3 }); // result = 8
let results = Formula.calc('2^x', [{ x: 2 }, { x: 4 }, { x: 8 }]); // results = [4,16,256]

// Scientific notation is supported for large or small numbers:
let result = Formula.calc('1.5e3 + 2.5e-2'); // result = 1500.025
let result = Formula.calc('6.022e23 * x', { x: 2 }); // result = 1.2044e24 (Avogadro's number * 2)

More options

Using multiple variables

const fObj = new Formula('a*x^2 + b*x + c');

// Just pass a value object containing a value for each unknown variable:
let result = fObj.evaluate({ a: 2, b: -1, c: 3, x: 3 }); // result = 18

Using named variables

You can use multi-character variable names. Brackets are optional but still supported for backwards compatibility:

const fObj = new Formula('2*var1 + sin(var2+PI)');

// Just pass a value object containing a value for each named variable:
let result = fObj.evaluate({ var1: 5, var2: 0.7 });

// Brackets are still supported if you prefer:
const fObj2 = new Formula('2*[var1] + sin([var2]+PI)');
let result2 = fObj2.evaluate({ var1: 5, var2: 0.7 });

Note: Since v4.0, operators must be explicit. Single-char variable shortcuts like 2x (meaning 2*x) are no longer supported. See Breaking Changes in v4.0 for more details.

Using named object path variables

Named variables in brackets can also describe an object property path:

const fObj = new Formula('2*[var1.propertyA] + 3*[var2.propertyB.propertyC]');

// Just pass a value object containing a value for each named variable:
let result = fObj.evaluate({ var1: { propertyA: 3 }, var2: { propertyB: { propertyC: 9 } } });

This even works for array values: Instead of the property name, use a 0-based index in an array:

// var2.propertyB is an array, so we can use an index for the 3rd entry of propertyB:
const fObj = new Formula('2*[var1.propertyA] + 3*[var2.propertyB.2]');
let result = fObj.evaluate({ var1: { propertyA: 3 }, var2: { propertyB: [2, 4, 6] } });

Using user-defined functions

const fObj = new Formula('sin(inverse(x))');

//Define the function(s) on the Formula object, then use it multiple times:
fObj.inverse = (value) => 1/value;
let results = fObj.evaluate([{ x: 1 }, { x: 2 }, { x: 3 }]);

// Or pass it in the value object, and OVERRIDE an existing function:
let result = fObj.evaluate({
	x: 2/Math.PI,
	inverse: (value) =>  (-1*value)
});

If the function is defined in the value object AND on the formula object, the Value object has precedence

Functions also support the object path syntax:

// in an evaluate() value object:
const fObj = new Formula('sin(lib.inverse([lib.x]))');
const res = fObj.evaluate({
	lib: { inverse: (value) => 1 / value, x: Math.PI }
});

// or set it on the Formula instance:
const fObj2 = new Formula('sin(lib.inverse(x))');
fObj2.lib = { inverse: (value) => 1 / value };
const res2 = fObj2.evaluate({ x: Math.PI });

You can also pass objects as function arguments:

const fObj = new Formula('distance(p1, p2)');
fObj.distance = (point1, point2) =>
	Math.sqrt(Math.pow(point1.x - point2.x, 2) + Math.pow(point1.y - point2.y, 2));

let result = fObj.evaluate({
	p1: { x: 1, y: 3 },
	p2: { x: 4, y: 7 }
}); // result = 5

Using strings

You can also pass strings as values or variable values (not only numbers): It is then in your responsibility to provide a function that can make sense of the string:

E.g. you can create a function that concats 2 values:

const fObj = new Formula('concat([var1], "Bar")');
let result = fObj.evaluate({ var1: 'Foo', concat: (s1, s2) => s1 + s2 });

Here, the result of the evaluation is again a string.

Of course you can use strings to make decisions: Here, we provide a function longer that returns the length of the longer of two strings, and calculates the remaining length:

const fObj = new Formula('20 - longer([var1], "Bar")');
let result = fObj.evaluate({ var1: 'FooBar', longer: (s1, s2) => s1.length > s2.length ? s1.length : s2.length });
// --> 14

You can use both double (") and single (') quotes as strings:

const fObj = new Formula('concat([var1], "Bar", \'Baz\')');

And you can escape quotes within strings

const fObj = new Formula('concat([var1], "Bar\"Be\"que")');

Using logical operators

Logical operators allow for conditional logic. The result of the evaluation is always 0 (expression is false) or 1 (expression is true).

Example:

Calculate a percentage value based on a variable x, but only if x is between 0 and 1:

const fObj = new Formula('(x >= 0) * (x <= 1) * x * 100');
let result = fObj.evaluate([{ x: 0.5 }, { x: 0.7 }, { x: 1.5 },  { x: -0.5 }, { x: -1.7 }]);
// --> [50, 70, 0, 0, 0]

This could be used to simulate or "shortcut" comparison functions. The same could be achieved with a user-definded function:

const fObj = new Formula('withinOne(x) * 100');
fObj.withinOne = (x) => (x >= 0 && x <= 1 ? x : 0);
let result = fObj.evaluate([{ x: 0.5 }, { x: 0.7 }, { x: 1.5 },  { x: -0.5 }, { x: -1.7 }]);
// --> [50, 70, 0, 0, 0]

NOTE: Logical operators have the LEAST precedence: 3 > 1 + 4 < 2 is evaluated as 3 > (1+4) < 2.

Conditional evaluation

The previous chapter introduced logical operators. This can be used to implement a conditional function, or if function:

Example: Kids get a 50% discount on a price if they are under 18:

const fObj = new Formula('ifElse([age] < 18, [price]*0.5, [price])');
const res = fObj.evaluate([{ price: 100, age: 17 }, { price: 100, age: 20 }]);
// --> res = [50, 100]

Re-use a Formula object

You can instantiate a Formula object without formula, and set it later, and even re-use the existing object:

const fObj = new Formula();
// ...
fObj.setFormula('2*x^2 + 5*x + 3');
let res = fObj.evaluate({ x: 3 });
// ...
fObj.setFormula('x*y');
res = fObj.evaluate({ x: 2, y: 4 });

Memoization

To avoid re-calculation of already evaluated results, the formula parser object supports memoization: it stores already evaluated results for given expression parameters.

Example:

const fObj = new Formula('x * y', { memoization: true });
let res1 = fObj.evaluate({ x: 2, y: 3 }); // 6, evaluated by calculating x*y
let res2 = fObj.evaluate({ x: 2, y: 3 }); // 6, from memory

You can enable / disable memoization on the object:

const fObj = new Formula('x * y');
let res1 = fObj.evaluate({ x: 2, y: 3 }); // 6, evaluated by calculating x*y
fObj.enableMemoization();
let res2 = fObj.evaluate({ x: 2, y: 3 }); // 6, evaluated by calculating x*y
let res3 = fObj.evaluate({ x: 2, y: 3 }); // 6, from memory

Blacklisted functions

The Formula class blacklists its internal functions like evaluate, parse etc. You cannot create a formula that calls an internal Formula function:

// Internal functions cannot be used in formulas:
const fObj = new Formula('evaluate(x)');
fObj.evaluate({ x: 5 }); // throws an Error

// This also counts for function aliases / references to internal functions:
const fObj = new Formula('ex(x)');
fObj.ex = fObj.evaluate;
fObj.evaluate({ x: 5 }); // still throws an Error: ex is an alias of evaluate

The Formula object keeps a function reference of all blacklisted functions in the Formula.functionBlacklist array.

You can get a list of all blacklisted functions:

let blacklistNames = Formula.functionBlacklist.map((f) => f.name));

Or you can check if a specific function is in the blacklist:

fObj = new Formula('x * y');
// fObj.evaluate is a Function pointer to an internal, blacklisted function:
Formula.functionBlacklist.includes(fObj.evaluate);

If you want to provide your own function for a blacklisted internal function, provide it with the evaluate function:

fObj = new Formula('evaluate(x * y)');
fObj.evaluate({ x: 1, y: 2, evaluate: (x, y) => x + y });

Now, evaluate in your formula uses your own version of this function.

Get all used variables

// Get all used variables in the order of their appearance:
const f4 = new Formula('x*sin(PI*y) + y / (2-x*[var1]) + [var2]');
console.log(f4.getVariables()); // ['x','PI','y','var1','var2']

Get the parsed formula string

After parsing, get the formula string as parsed:

// Get all used variables in the order of their appearance:
const f = new Formula('x      * (  y  +    9 )');
console.log(f.getExpressionString()); // 'x * (y + 9)'

Pre-defined functions

ifElse

The ifElse function is a functional implementation of the if/else statement:

If the predicate evaluates to true(-ish), the trueValue is returned, else the falseValue is returned:

// If the given age is < 18, give a 50% price reduction:
const fObj = new Formula('ifElse([age] < 18, [price]*0.5, [price])');
const res = fObj.evaluate([{ price: 100, age: 17 }, { price: 100, age: 20 }]);

In an imperative languate, this is equivalent to:

if (age < 18) {
	return price * 0.5;
} else {
	return price;
}

Because ifElse is just a function expression, you can even nest it. The next example also combines the usage of object functions to check if a person is under 18, and goes to a supported school, then we give it a reduction:

const fObj = new Formula(`
	ifElse([person.age] < 18, 
		ifElse(schoolNames.includes([person.school]), 
			[price]*0.5, 
			[price]
		),
		[price]
	)
`);
let res = fObj.evaluate({
	person: { age: 17, school: 'ABC Primary' },
	price: 100,
	schoolNames: ['Local First', 'ABC Primary', 'Middleton High']
});
// res = 50: the person is < 18, and goes to a supported school, so we apply the reduced price.

That almost feels like programming!

first

The first function selects the first true-ish value from multiple arguments:

const fObj = new Formula('a * first(x, y, z)');
let res = fObj.evaluate({ a: 10, x: 0, y: -2, z: 0 }); // -20: y is selected as the first non-nullish value

TODO: fparser does not support array values for now: so it is not possible to use an array/list structure or variables containing an array. This will be implemented in a future release.

Changelog

V4.2.0

  • [Feature] Scientific notation support: Numbers can now be expressed in scientific notation (e.g., 1.23e5, 1.5E-10, -2.5e+3). Both lowercase e and uppercase E are supported, with optional explicit + or - signs in the exponent.

V4.1.0

  • [Change] Tokenizer refactoring: Using true Regex pattern matching instead single-char matching. This makes the tokenizing part much more readable.
  • [Feature] Pass object values to formula functions: Functions now accept JavaScript objects as function parameter values.
  • [Feature] Return the UMD build (CommonJS / Global variable): this was (accidentially / intentionally) removed in V4.0.0

V4.0.0

This is a major release with significant architectural improvements and some breaking changes. See Breaking Changes in v4.0 for migration guide.

New Architecture:

  • [Change] Complete parser refactoring: Separated tokenization and parsing into two distinct phases
  • [Change] Implemented regex-based tokenizer for cleaner, more maintainable code
  • [Change] Implemented Pratt parsing algorithm for operator precedence handling
  • [Change] Removed 270+ lines of complex state machine code
  • [Feature] Better error messages with token position information

Breaking Changes:

  • [Breaking] Implicit multiplication removed: 2x must now be written as 2*x
  • [Breaking] Power operator (^) is now right-associative: 2^3^2 evaluates as 2^(3^2) instead of (2^3)^2
  • [Breaking] Removed public methods: isOperator(), isOperatorExpr(), splitFunctionParams()
  • [Breaking] Separating ES Module and CommonJS / UMD builds: use fparser.js for ES 6 modules, and fparser.umd.cjs for CommonJS / global JS environments

Improvements:

  • [Feature] Multi-character variables no longer require brackets: myVar instead of [myVar] (brackets still supported)
  • [Feature] ifElse() function for conditional evaluation added
  • [Feature] first() function selects the first true-ish value from multiple arguments

V3.1.0

  • [Feature] Adding Logical Operators <, >, <=, >=, =, !=

V3.0.1

  • [Bugfix] Fixing main entry in package.json: The 3.0.0 build could not be used as ES 6 module import with the non-existing main entry.

V3.0.0

This is a long-wanted "migrate to typescript and modernize build infrastrucure" release. It introduces some few breaking changes, which hopefully are simple to adapt in existing code, or does not affect end users at all (I hope).

  • [Breaking]: new build system (vitejs instead of webpack)
  • [Breaking]: UMD module version available as dist/fparser.umd.js instead of dist/fparser.js: If you need the UMD version, use dist/fparser.umd.js instead of dist/fparser.js.
  • [Breaking]: An empty formula now throws an Error when parsed.
  • [Breaking]: VariableExpression class now needs Formula instance in constructor. This should not affect any end-user, but I did not test all edge cases.
  • [Change]: Migrating source code to TypeScript. This should not affect end-users.
  • [Feature]: Variables and functions now both support object paths (e.g. obj.fn(3*[obj.value]))

V2.1.0

  • [Breaking]: Blacklisting internal functions: You cannot use internal functions as formula function anymore.
  • [Feature]: Supporting object paths as variable values (e.g. 3*[obj1.property1.innerProperty]), thanks to SamStonehouse
  • [Change]: Updated build infrastructure: upped versions of build tools

V2.0.2

  • Fixing Issue #22: If the formula started with a single negate variable (e.g. -z*t), the parser got confused.

V2.0.0

This release is a complete re-vamp, see below. it should be completely backward compatible to the 1.x versions, but I did not test all edge cases.

  • Switched to MIT license
  • complete refactoring of the parsing and evaluating part: The parser now creates an Expression Tree (AST) that saves extra time while evaluating - Evaluation now only traverses the AST, which is much faster.
  • added getExpressionString() function to get a formatted string from the formula
  • adding support for memoization: store already evaluated results
  • Switched bundler to webpack
  • fixed some parser bugs

V1.4.0

  • Adding support for named variables (2x + [var1])
  • switched testing to chromium runner instead of PhantomJS

V1.3.0

  • modernized library: The source is now ES6 code, and transpiled in a dist ES5+ library.
  • Make sure you include dist/fparser.js if you are using it as a browser library.
  • Drop support for Bower, as there are more modern approaches (npm) for package dependency nowadays

Contributors

Thanks to all the additional contributors:

  • LuigiPulcini for:
    • the Strings support
    • the Logical Operator support

TODOs, Whishlist

  • support for double- and single quote strings (now: only double quotes) Done in V4.0
  • Implement standard logic functions:
    • first(...args): the first trueish (> 0) arg is returned as value. If none are trueish, the last element is returned.
    • ifElse(predicate, trueValue, falseValue): returns the trueValue if the predicate is trueish (> 0), else the falseValue is returned
    • true(expr): returns 1 if the expression is trueish (> 0, true, strlen > 0), else 0
    • mod(x, y): returns x % y, div(x, y): returns x / y (integer division / modulus). Modulus could also be implemented as % operator
  • Get rid of the short form 3x instead of 3*x - DONE in v4.0: Implicit multiplication removed, operators must be explicit
  • allow arrays as variable values, to be used in functions or other context
  • Refactor / rebuild parser - DONE in v4.0: Parser completely refactored with separate tokenization and Pratt parsing

License

Licensed under the MIT license, see LICENSE file.

Packages

No packages published

Contributors 3

  •  
  •  
  •