Top Research Papers on Data Engineering

The Bulletin of the Technical Committee on Data Engineering is published quarterly and is distributed to all TC members and the current issue is on parallelism in industrial database systems, where Betty Salzberg has succeeded in gathering papers on parallelism in ve systems.

Businesses are quickly realizing that data scientists can only go so far without the team in place to support their day-to-day work, but more importantly to operationalize their work.

The importance of data abstraction in the specification, design and implementation of large systems raises the question as to whether such methods may be applied in the context of programming languages designed before the widespread use of abstraction techniques.

This article shows that open-source data sets are the rocket fuel for research and innovation at even some of the largest AI organizations, and analysis of nearly 2000 research publications from Facebook, Google and Microsoft over the past five years shows the widespread use and adoption of open data sets.

An introduction to computer based data management is presented with an orientation toward the needs of engineering application and a link to familiar engineering applications of computing is established through a discussion of data structure and data access procedures.

Geodise is a Grid-enabled, intelligent engineering design and optimisation search environment that provides engineers with a central point of access to a suite of tools that will enable them to improve designs, keep track of running and past jobs, and obtain advice.

The connotation of data engineering in information system construction is described, and data actions involved in data engineering are classified into five classes: regulations and policies, planning and design, acquisition and processing, application and maintenance, archiving and monitoring.

The government of Tegal city doesn’t currently have the media used to publicize land use, the socialization of land use is rarely done, so that this may cause some problems, and the Land Use Mapping System in Tegal City Area becomes a solution to the problems.

This article discusses how the data requirements of information systems influence the structure of the distributed computer systems upon which they are often built.

This book discusses in detail the lower layers of the OSI model and includes a thorough description of coding - source, channel and line.

Solutions to two major data defects (autocorrelation and multicolinearity) commonly encountered in the use of multivariable linear regression analysis when applied to engineering data are described. A computer program, incorporating a new method for the determination of the ridge parameter, is introduced for their implementation. The methods described are then applied to a complex data set involving a demonstration of the use of densified refuse-derived fuel burned in an industrial spreader stoker boiler. The analysis shows that, had only the more conventional regression analysis been applied,...

Author points out that engineering data should authentic, accurate, in time and integrated to provide reliable references for class evaluation of construction quality.

This paper attempts to bring about a better understanding of the difficulties associated with this task by considering sources of complexity in SDE design.

Mechanisms based on DBV and DBV graph concepts, proposed in EDBMS/2, make EDB MS/2 own powerful abilities for version management and run efficiently.

Results improved management of data exchange among disparate systems and up-front studies of vendor offerings, potential problems, and long-term needs.

The Python-based pipeline not only provides an efficient and scalable solution for handling OLX data but also facilitates easy integration with popular analytics tools, empowering users to derive actionable insights for strategic decision-making.

This paper illustrates the existing problems in regulation implement,and proposes relevant suggestions from improving the quality of personnel,strengthening standard management of engineering data,and increasing the strength of monitoring in light of various nonstandard behaviors,which to offer important references to ensure and improve engineering quality.

This paper is a tutorial presentation on data management and data engineering, focusing more on the critical issues that are relevant to both studies but justifying the recent paradigm move towards data engineering.

This thesis explores the high performance computing (HPC) environment used in aerospace engineering design, about which little was previously known, and applies the findings to the specific problem of file system cleaning.

This work outlines three diverse applications to the economics of information; to life-cycle employment, earnings, and spending; and to public policy analysis and provides a general overview of the engineering process.