Data augmentation using semantic transforms
Abstract
A method of data augmentation includes receiving, by a processor, a set of data including a plurality of variables, mapping each variable to one or more target concepts associated with a name of each variable, and acquiring a set of semantic transforms, each semantic transform including a function applied to one or more concepts mapped to a respective variable. The method also includes comparing the one or more target concepts to the one or more concepts of each semantic transform, selecting at least one semantic transform based on the comparing, generating an expression for each selected semantic transform, each expression configured to apply a function of a selected semantic transform to at least one of the plurality of variables, and augmenting the set of data for use in an application by adding each expression to the set of data.
Claims
exact text as granted — not AI-modifiedWhat is claimed is:
1 . A method of data augmentation, comprising:
receiving, by a processor, a set of data including a plurality of variables; mapping each variable to one or more target concepts associated with a name of each variable; acquiring a set of semantic transforms, each semantic transform including a function applied to one or more concepts mapped to a respective variable; comparing the one or more target concepts to the one or more concepts of each semantic transform, and selecting at least one semantic transform based on the comparing; generating an expression for each selected semantic transform, each expression configured to apply a function of a selected semantic transform to at least one of the plurality of variables; and augmenting the set of data for use in an application by adding each expression to the set of data.
2 . The method of claim 1 , wherein the application includes a machine learning application.
3 . The method of claim 1 , wherein the set of semantic transforms is stored in a transform repository, each semantic transform including a function indexed to one or more concepts.
4 . The method of claim 3 , wherein acquiring the set of semantic transforms includes selecting the set of transforms from the repository based on a level of similarity between a stored semantic transform and a target concept.
5 . The method of claim 1 , wherein the set of data includes tabular data having a column associated with each variable, and augmenting the set of data includes creating a new column for each expression.
6 . The method of claim 5 , wherein the new column is indexed based on the name of at least one variable and includes values calculated based on the expression.
7 . The method of claim 1 , wherein generating the expression includes replacing each concept in a selected semantic transform with a variable name associated with the concept.
8 . A system comprising:
a memory device; and one or more processing units coupled with the memory device, the one or more processing units are configured to perform a method of data augmentation, the method comprising:
receiving a set of data including a plurality of variables;
mapping each variable to one or more target concepts associated with a name of each variable;
acquiring a set of semantic transforms, each semantic transform including a function applied to one or more concepts mapped to a respective variable;
comparing the one or more target concepts to the one or more concepts of each semantic transform, and selecting at least one semantic transform based on the comparing;
generating an expression for each selected semantic transform, each expression configured to apply a function of a selected semantic transform to at least one of the plurality of variables; and
augmenting the set of data for use in an application by adding each expression to the set of data.
9 . The system of claim 8 , wherein the set of semantic transforms is stored in a transform repository, each semantic transform including a function indexed to one or more concepts.
10 . The system of claim 9 , wherein acquiring the set of semantic transforms includes selecting the set of transforms from the repository based on a level of similarity between a stored semantic transform and a target concept.
11 . The system of claim 8 , wherein the set of data includes tabular data having a column associated with each variable.
12 . The system of claim 11 , wherein augmenting the set of data includes creating a new column for each expression.
13 . The system of claim 12 , wherein the new column is indexed based on the name of at least one variable and includes values calculated based on the expression.
14 . The system of claim 8 , wherein generating the expression includes replacing each concept in a selected semantic transform with a variable name associated with the concept.
15 . A computer program product comprising a computer-readable memory that has computer-executable instructions stored thereupon, the computer-executable instructions when executed by a processor cause the processor to perform operations comprising:
receiving a set of data including a plurality of variables; mapping each variable to one or more target concepts associated with a name of each variable; acquiring a set of semantic transforms, each semantic transform including a function applied to one or more concepts mapped to a respective variable; comparing the one or more target concepts to the one or more concepts of each semantic transform, and selecting at least one semantic transform based on the comparing; generating an expression for each selected semantic transform, each expression configured to apply a function of a selected semantic transform to at least one of the plurality of variables; and augmenting the set of data for use in an application by adding each expression to the set of data.
16 . The computer program product of claim 15 , wherein the set of semantic transforms is stored in a transform repository, each semantic transform including a function indexed to one or more concepts.
17 . The method of claim 16 , wherein acquiring the set of semantic transforms includes selecting the set of transforms from the repository based on a level of similarity between a stored semantic transform and a target concept.
18 . The computer program product of claim 15 , wherein the set of data includes tabular data having a column associated with each variable.
19 . The computer program product of claim 18 , wherein augmenting the set of data includes creating a new column for each expression, and the new column is indexed based on the name of at least one variable and includes values calculated based on the expression.
20 . The computer program product of claim 15 , wherein generating the expression includes replacing each concept in a selected semantic transform with a variable name associated with the concept.Cited by (0)
No later patents cite this yet.
References (0)
No backward citations on record.