Settings Results in 4 milliseconds

ASP.NET 8 Best Practices: Coding, Performance Tips ...
Category: .Net 7

In this chapter, we will explore various best practices and performance tips to enhance your ASP. ...


Views: 368 Likes: 98
IT Java Application Supervisor
Category: Technology

Title IT Java Application Supervisor Location Clevela ...


Views: 0 Likes: 40
[Software Development] Discover ErnesTech Step-by- ...
Category: Computer Programming

At ErnesTech, we take a collaborative approach to ensure your satisfaction and success. Our seaml ...


Views: 0 Likes: 33
Lead Software Engineer
Category: Jobs

LawnStarter is a marketplace that makes lawn care easy for homeowners while helping small busines ...


Views: 0 Likes: 34
Lead Drupal Developer with Third and Grove
Category: Jobs

This position is fully remote. Office space is available for co-working at our Boston HQ.&nbsp;<s ...


Views: 0 Likes: 40
Linking Multiple Asp.net Projects Together
Category: .Net 7

For large applications, let's say Asp.net application that is really large and supports multiple bus ...


Views: 353 Likes: 102
QA Test Lead Consultant/SAP Project (8+ month cont ...
Category: Jobs

Major Financial Services company has an immediate need for a QA Test Lead for an SAP integration ...


Views: 42 Likes: 79
Full Stack Software Developer
Category: Jobs

We have an opening for a Full Stack Software Developer. Please send resumes asap for our team to ...


Views: 0 Likes: 76
Sr. Software Engineer
Category: Technology

As one of our engineers, you&rsquo;ll help guide key development and technology decisions in our ...


Views: 0 Likes: 51
Principal Engineer @ RE/MAX
Category: Technology

First is fundamentally changing the real estate industry.&nbsp; We believe that operational excel ...


Views: 0 Likes: 51
Login failed for user . (Microsoft SQL, Error: 184 ...
Category: SQL

Problem When you are trying to login into SQL Server with a ne ...


Views: 373 Likes: 108
Technical Project Manager
Category: Jobs

"IMMEDIATE REQUIREMENT" Please share the suitableprofile to&nbsp;<a href="mailtoelly.jack ...


Views: 0 Likes: 29
Graham Capital Management comes to CDS
Graham Capital Management comes to CDS

This Friday, Graham Capital Management (GCM) introduced our CDS students to the career opportunities available for them in financial investing. Established in 1994, GCM is a leading macro-oriented investment firm based in Connecticut, with another office located in London, UK. The firm manages their clients’ portfolios in one of two ways discretionary or quantitative strategies. The discretionary approach is where industry experts in the firm are given considerable free reign to manage individual portfolios. But the quantitative strategies are where the data scientists are needed. While several financial firms believe in efficient market analysis, GCM applies innovative scientific research to consistently generate strong returns. They collect a range of financial data like price action, macroeconomic data, volatility, supply and demand records, and market sentiments. Then, they design trading strategies that run money systematically for their clients on over 100 different markets. GCM’s data-driven approach has continually given them—and their clients—a major advantage, especially during the financial crisis in 2008. Central to their continual success is prioritizing quality over quantity when it comes to recruitment. Although they only have roughly 200 personnel, their staff comprises of talented individuals with advanced degrees in computer science, machine learning, economics and, of course, data science. Unsurprisingly, then, GCM’s office culture is a highly collaborative and interdisciplinary one. Interestingly, GCM’s talented employees frequently borrow from academic practices to improve their own research, like emphasizing teamwork, peer review, and holding internal conferences. They also keep a close eye on the research produced by technology giants like Google and Facebook so that they can adopt new techniques into their trading strategies. As a data-driven investment firm, GCM always seeks graduates whom, like our CDS students, have demonstrated quantitative competency and developed some financial acumen. Located in a marvelous mansion in Connecticut (with a free gym and cafeteria!), GCM is a promising option for our graduates.   by Cherrie Kwok


How to Make Sure Your Application is Secure
Category: Computer Programming

This is a leading topic nowadays, Securi ...


Views: 0 Likes: 30
Senior Full Stack Developers/Front End Angular, Py ...
Category: Jobs

Please contact me regarding an immediate position for Senior Full Stack Engineers/Developers to d ...


Views: 20 Likes: 77
The instance of entity type 'IdentityUserLogin<str ...
Category: .Net 7

Questions How do you solve The instan ...


Views: 455 Likes: 68
SQL Developer
Category: Jobs

Would you be interested in the following long-term opportunity? &nbsp; If not int ...


Views: 0 Likes: 64
Vasant Dhar on Using Data Science to Tackle Educational Problems
Vasant Dhar on Using Data Science to Tackle Educat ...

While the proliferation of data science is most commonly associated with fields such as finance, marketing, and the technology sector, data science has become increasingly important in a variety of disciplines, including health, medicine, and education. Vasant Dhar, a professor at the Center for Data Science, began incorporating data science into his research in the 1990s.  He was originally working in the financial sector, but over the course of his career, his research interests have expanded to a broad range of fields, including sports and health care. Dhar is mostly known for his ongoing work in the financial sector, but he recently began to investigate the role of data science in tracking educational standards, specifically in his home country, India.  One of his ongoing research projects is exploring the possibility of using educational smartphone games to assist in childhood education. Dhar said, “It’s a big problem in India… good teachers are few and far between.”   While Dhar does not believe that educational smartphone games can replace a human teacher, he sees them as a way to supplement classroom experiences, and gain valuable data regarding how children are learning. Dhar said, “We’re gathering lots of telemetry data from people interacting with their devices. Once you collect that data, you can infer something about what kids are looking at, what they’re playing, and how well they’re playing a given game.” But Dhar also stressed that certain societal norms are key to understanding how data science can be implemented in a community. “Games are one part of it… but you also have to account for social and cultural factors within the country that you’re dealing with. A lot of parents don’t think their kids are learning something when they’re playing games. They think that’s not work, that’s play. So it’s a bit of a challenge to figure out how to seamlessly integrate the device and it’s usage,” Dhar said. He continued, “It’s not just the technical issue, it’s the socio-ethical issue. What you’re doing is designing technology to be integrated with the way people work, and their social boundaries.” Vasant Dhar’s dilemma captures an essential piece of knowledge concerning data science while a solution to a problem might be theoretically sound, real-world effectiveness is crucial.  As data science becomes increasingly prevalent, it is essential that domain expertise goes hand-in-hand with insight from those who are most knowledgeable about the communities that data scientists seek to serve.


[Git] Your local changes to the following files wo ...
Category: Git

[Git Error] You ...


Views: 451 Likes: 84
Rails Engine - File to import not found or unreada ...
Category: Network

Problem When developing using Ruby and Rails and you start up a Rails Server using command <spa ...


Views: 321 Likes: 90
Senior Full Stack Developers/Front End Angular, Py ...
Category: Jobs

Please contact me regarding an immediate position for Senior Full Stack Engineers/Developers to d ...


Views: 21 Likes: 73
How to Solve XUnit Automated Testing Error: Castle ...
Category: MVC

How to Solve the XUnity Automated Test Error</s ...


Views: 1715 Likes: 114
Technical Project Manager
Category: Jobs

"IMMEDIATE REQUIREMENT" Please share the suitableprofile to&nbsp;<a href="mailtoelly.jack ...


Views: 0 Likes: 32
Forward Traffic to Another IP Address
Category: Technology

How to Forward Traffic from a Hosting ...


Views: 367 Likes: 99
Solutions Architect & Developer (remote job) at Re ...
Category: Jobs

Solutions Architect &amp; Developer Compensation <span ...


Views: 0 Likes: 30
What is the difference between Cookie based Authen ...
Category: Research

Cookie-based authentication and bearer token-based authentication are two common methods used fo ...


Views: 0 Likes: 26
Senior Full Stack Developers/Front End Angular, Py ...
Category: Jobs

Please contact me regarding an immediate position for Senior Full Stack Engineers/Developers to d ...


Views: 21 Likes: 96
How to Use Git Flow
Category: Git

<span style="font-family Arial; color #000000; background-color transparent; vertical-align ...


Views: 376 Likes: 80
Hiring for .NET Developers - Cleveland, OH - Fortu ...
Category: Jobs

Job Description&md ...


Views: 0 Likes: 12
SQL Developer
Category: Jobs

Would you be interested in the following long-term opportunity? &nbsp; If not int ...


Views: 0 Likes: 73
Full Stack developer to join our team developing a ...
Category: Jobs

This position is with a well-established and financially secure organization in need of a full st ...


Views: 6 Likes: 51
Why Software Design and Architecture is very impor ...
Category: Computer Programming

Thorough System Analysis becomes vital t ...


Views: 0 Likes: 31
Faculty Interview: Dustin Duncan
Faculty Interview Dustin Duncan

Dustin Duncan is an Affiliated Faculty member at the Center for Data Science, an Assistant Professor at NYU’s Department of Population Health, and the Principal Leader at the Spatial Epidemiology Lab.  His work focuses on the intersection of of public space and personal health, backed by a fundamental understanding of data science. What did you study in school?  How did you get to what you study now? As an undergraduate student at Morehouse College, I majored in Psychology and minored in Public Health Sciences.  I completed my master’s work at the Harvard T.H. Chan School of Public Health (HSPH), and went on to complete my doctorate in Social Epidemiology at HSPH, in addition to being an Alonzo Smythe Yerby Postdoctoral Fellow at HSPH from 2011 to 2013. How did you become interested in social epidemiology? I became interested in studying the social epidemiology of neighborhoods during my master’s program, when I was a research assistant at Dana-Farber Cancer Institute’s Center for Community-Based Research (DFCI).  At DFCI, I co-authored a paper demonstrating that perceiving one’s neighborhood as unsafe is associated with reduced walking among urban predominantly racial/ethnic minority low-income adults.  This was my first published peer-reviewed paper, and was published in PLoS Medicine. In spatial epidemiology, are you using data science to look at the ways in which health outcomes are affected on a micro-level (such as disease mapping and clustering), or is it more of a macro view (which areas are most likely to be affected)?  My research embraces a social ecological perspective, interrogating the impact of different “levels” on people’s health.  However, the majority of our work is at the community level, where we investigate how neighborhood characteristics can influence population health and health disparities in vulnerable populations predominantly in urban environments. Can you talk about the history of the field of spatial epidemiology and how it has evolved over time with advancements in statistics and data collection? Social scientists have long recognized the salience of context in health.  For instance, Louis René Villermé, a noted French physician and statistician, studied neighborhood effects on health in Paris.  In 1830, he published a paper examining mortality patterns in different Parisian neighborhoods, and found that observed differences in death rates were highly correlated with the degree of poverty in a given neighborhood.   Sadly though, over the years, research has been primarily focused on biomedical individualism (i.e. individual-level factors).  But there has been a resurgence of interest in context as it relates to health, which stems from an increasing appreciation for recognizing that a myriad macro-social factors are important to health.  Recently, the field of spatial epidemiology has seen data collection shifts stemming from technological advancements and the use of newer statistical methods.  My colleagues and I are using GPS technology to define more realistic views of neighborhood contexts called “activity space neighborhoods.”  My work has argued that, compared to static administrative boundaries— such as ZIP codes and census tracts—egocentric and GPS-defined neighborhoods are the best methods in defining neighborhood contexts. What sorts of public health problems are you trying to study?   My lab, the Spatial Epidemiology Lab (www.spatialepilab.org), employs a geospatial lens in studying health behaviors and outcomes, especially obesity, hypertension, type 2 diabetes, drug abuse, and HIV/AIDS. Can you give a couple of examples of specific projects? With funding from NYU’s Center for Drug Use and HIV Research, and My Brother’s Keeper, my colleague Dr. DeMarc Hickson—from the Jackson State University School of Public Health—and I are currently conducting a study to examine the feasibility of obtaining GPS spatial behavior data among a sample of approximately 100 black men who have sex with men in metropolitan centers in the Southern United States. Also, I recently received a National Institute for the Humanities award for a project that uses advanced GPS methods to understand how certain neighborhoods influence HIV outcomes in New York City.  The study will use real-time geospatial methods to investigate mobility across neighborhoods and how this affects HIV risk among young men who have sex with men. When did you start to incorporate data science into your research? Data science has been an increasingly important element to my research for some time now.  In my studies of neighborhoods and health, for example, we have utilized novel data sources such as Walk Score, Grindr and electronic health records. How are you using these data sources? Walk Score’s web-based algorithm calculates a score of walkability based on distance to various categories of amenities (e.g. schools, stores, parks, and libraries).  We’ve documented associations between Walk Score and cardiometabolic outcomes.  That is to say, living in a more walkable neighborhoods is associated with increased walking in neighborhoods, less body mass index, less waist circumference, less systolic blood pressure, less diastolic blood pressure and a lower resting heart rate. Electronic health records can be utilized to collect objectively measured clinical health data, as a way of correcting errors and biases associated with self-reported survey measures.  Because electronic health records have address data, researchers can geocode that information to estimate neighborhood-level factors to link to clinical health outcomes. In a recent study, we examined the association of walkable built environment characteristics with body mass index (BMI) among a large sample of children and adolescents.  We found that built environment characteristics that increase walkability were associated with a lower BMI. Additionally, my work uses GPS devices and smartphones to examine social networks in neighborhoods.  Geosocial-networking applications, such as the dating application Grindr, utilize GPS technologies to allow users to browse user profiles and facilitate connections between users based on physical proximity.  Grindr is a commonly and widely used geosocial-networking smartphone application for sexual minority men to meet anonymous sexual partners, creating a new digital environment worthy of further investigation in studies of sexual risk behavior and substance use in sexual minority men. My recent work has been some of the first of its kind to utilize broadcast advertisements on Grindr to recruit participants and deliver surveys to assess risk behaviors of application users. What drew you to the CDS program at NYU? I was drawn to the CDS program at NYU in part because of its interdisciplinary commitment and perspective. The key to making advances in the world of public health really depends on different sectors and disciplines working together. For example, in my own research, I engage with colleagues trained in a wide range of disciplines— economics, engineering, statistics, medicine, geography, sociology and psychology— because each can bring unique knowledge and perspectives to the study, making the work stronger and more relevant.


Senior Software Engineer - Product
Category: Jobs

Senior Software Engineer &ndash; Product &nbsp; Do you thrive on ...


Views: 0 Likes: 34
What's New: High Paying Jobs and How to stay Produ ...
Category: General

Hello Software Developers,Here is the update for this weekThis week at Er ...


Views: 0 Likes: 39
Coding Bootcamp Graduate Searching for Job
Category: Jobs

Hello! I am a recent graduate from the coding Bootcamp Tech Elevator and am actively searching fo ...


Views: 214 Likes: 114
QA Test Lead Consultant/SAP Project (8+ month cont ...
Category: Jobs

Major Financial Services company has an immediate need for a QA Test Lead for an SAP integration ...


Views: 47 Likes: 54
NYU Scientists Invent New Protein for Regenerative Medicine
NYU Scientists Invent New Protein for Regenerative ...

“How,” crooned British pop band the Bee Gees to their fans in the 1970s, “can you mend a broken heart?” Well, those working in the field of regenerative medicine may have an answer. Focused on discovering ways to replace or regenerate organ tissues that are damaged from aging or disease, the field envisions a future where those with spinal cord injuries can walk again, where entire organs can be regenerated for transplants and, of course, where broken hearts can be healed or replaced. A major challenge facing the field, however, is creating biosynthetic materials that can not only deliver targeted drug therapy or tissue engineering to a damaged area, but also non-invasively visualize the surrounding cells so that doctors can monitor their patient’s treatment progress. Although some advances have been made, a full solution has not yet been discovered?—?but it looks like Associate Professor Jin Montclare from NYU Tandon, CDS’s Director Richard Bonneau, and Associate Professor Youssef Zaim Wadghiri from NYU School of Medicine are on their way to cracking the case. Over the last couple of years, Montclare, Bonneau, and Wadghiri’s research teams have been developing a groundbreaking protein-engineered coiled-coil that can self-assemble into fibers like collagen, a vital protein responsible for generating connective tissues in our bodies. Their clever protein is the first of its kind to be engineered on a micrometer scale, and closely mimics the structural and molecular similarities of self-assembling proteins already found in nature. Moreover, their engineered protein microfibers can also bind to other small molecules like curcumin, meaning that they have the potential to store and deliver specific chemical agents to treat affected cells. With the support of an NSF grant valued at $1,585,544, they are moving onto the next phase of their project adding an imaging component. Knowing that processes like MRI scans map cells by coating them with fluorine (a chemical element acting as a tracer) or iron oxide nanoparticles (magnetic contrast agent), they want to tag their protein engineered coiled-coil microfibers with the same element or tracer so that doctors can use biomedical imaging to determine whether the drugs have been successfully delivered, and gather data about treatment progress. Taking a computational approach, they will further develop their protein engineered coiled-coil using Rosetta, a powerful platform that not only performs protein folding predictions but also helps biologists design new proteins. Crucially, data collected from fully characterized proteins and initial experiments will be used to refine new computational designs as they are made. Bonneau, a core member behind Rosetta’s development, will provide his expertise during the project’s design and testing stage, while Wadghiri’s radiology experience will guide the construction of appropriate fluorine probes for bioimaging. Their innovative project is poised to transform the field of regenerative medicine. And, it also incorporates an excellent mentoring opportunity for young scientists. As part of NYU’s Scientific Outreach and Research program (SOAR) founded by Montclare, undergraduates will be hired to teach the high school students of Urban Assembly Institute for Math and Science for Young Women (UAI) about the biomaterials and biomedical imaging that are a part of this research project. “The goal here,” Montclare explained, “is to successfully impact these young women in a way that links all these disciplines together while also relating the work to practical real-world applications such as imaging and biomedicine.” By Cherrie Kwok


How Effective are Neural Networks for Object Recognition?
How Effective are Neural Networks for Object Recog ...

A few weeks ago, The New Yorker magazine published a story titled “Total Recall,” in which one of their correspondents, Patrick Radden Keefe, traveled to England to interview a team of “super-recognizers.” While most humans have spots of trouble putting names to faces, super-recognizers have an uncanny ability to recognize human faces. The city of London is known for a relatively high number of security cameras, and the city’s Metropolitan Police Service has begun employing these super-recognizers to comb through footage of unsolved crimes. The results have been successful, and other police departments around the world are now considering similar tactics. When asked about the possibility of a computer program aiding in the process of facial recognition, the idea was entirely dismissed by several of these super-recognizers. Although technology is not replacing super-recognizers yet, researchers from the Center for Data Science have been working to bridge the gap between human and machine visual recognition for quite some time, and with promising results. In 2014, three researchers from NYU—Avi Ziskind, a former Postdoctoral Researcher at NYU’s Psychology department, Yann LeCunn, from the Center for Data Science, and Denis Pelli, from NYU’s Computer Science Department—gave a presentation titled, “Two Machine-Learning Models of Object Recognition Exhibit Key Feature of Human Performance” at the 2014 Moore-Sloan Data Science Initiative Launch Event. They presented their research on two machine-learning models that had been trained to exhibit human-like levels of object recognition. The first model was a convolutional neural network, a type of model that is loosely based on the ways in which the human brain functions. The second was a texture statistics model, which measures the probability that a given image matches a previously known image. When given pieces of text, the models displayed two hallmarks of human recognition an understanding of both spatial frequency and font complexity. In The New Yorker article, the possibility of computer-based facial recognition was partially dismissed because super-recognizers often deal with grainy footage, or images that are poorly lit. But the models developed by Ziskind, LeCunn, and Pelli were well equipped to deal with visual noise, at least in the case of text. The two graphs below measure the neural network’s performance against a human observer. The network was trained to accommodate for two types of visual noise which are also present in human vision white noise and 1/f noise. When trained for both types of noises, the threshold curve for the neural network was remarkably similar to the threshold curve for human vision, and in some cases, the neural network exhibited a higher threshold for recognizing text. The texture statistics model did not perform as closely to its human vision counterpart, but still performed well overall. While text analysis is a different beast than facial recognition, the core concepts are not fundamentally different. The work of Ziskind, LeCunn, and Pelli shows that computer facial recognition may be much closer closer than we think.


Disney Stock Jumps on Solid Earnings
Category: General

Once upon a time in the bustling kingdom of Wall Street, there was a magical company known as Di ...


Views: 0 Likes: 9
How Can Data Collection Be Used to Map City Sounds?
How Can Data Collection Be Used to Map City Sounds ...

If you want to avoid traffic in a city or congested area, there are applications such as Google Maps and Waze to help you get around. But what about avoiding noise and distracting sounds? The Citygram-Sound Project—a joint collaboration between NYU Steinhardt, NYU’s Center for Urban Studies and Progress, and CalArts—is trying to combat this gap in available data, by mapping the acoustic soundscapes of cities to better understand how noise pollution affects urban dwellers. The project even includes two faculty members from the Center for Data Science, Claudio Silva and Juan Bello. Citygram was started in 2011, when Tae Hong Park, an Associate Professor of Music Technology and the Director of Music Composition at NYU Steinhardt, began mapping spatio-acoustic energy through a network of sensors spread throughout New York, Los Angeles, and other major cities. Park said, “I observed that there were no soundmaps of the city. It is a challenge because spatio-acoustic information is fleeting and cannot be represented via current spatial mapping techniques and paradigms,” In an interview with the New York Times, Arline Bronzaft, an environmental psychologist, said that learning to live with noise causes a toll on one’s body. Aside from hearing impairment, noise also has affects such as hypertension, sleep deprivation, and cardiovascular complications. Quantifying acoustic energy and mapping it could lead to better research on the impact of noise on health, and help dispel the notion that noise is something people can learn to live with. Previous efforts to collect sound-related data tried to gather information through a small number of sensors that could could track an expansive area. Park said that this approach was lacking, and that his team has “embraced the idea that more sensors would produce greater spatially density, and and greater temporal density.” To facilitate this sort of expansive network, Citygram has developed applications that will turn any computing device with an internet connection and a microphone into a sensor that can collect data on acoustic energy. Park said that leveraging public interest would be necessary to creating the spatially and temporally dense sensor network required to accurately map acoustic energy in large spaces. In exchange for allowing Citygram to collect data through their phones, users would benefit by gaining access to sound visualizations of their respective area. Park envisions the project as a community effort, where Citygram provides the available technological infrastructures, and urbanites contribute by using their smartphones or laptops. Park said, “We will soon release this technology so that everyone can use it, and become an active participant in mapping our urban noisescapes.” One potential hesitation that users may have is the issue of privacy. Park said, “I think one of the difficulties is the current perception of technologies that are already part of the urban environment, such as cameras. We need to find ways to address concerns that folks may have.” Citygram collects data in the form of feature vectors, which are numerical representations in the field of machine learning, making it is almost impossible to recreate the original sound. The team is also developing a “voice blurring approach” to obscure human voice signals. Park said, “I think it is a topic that is still very much sci-fi in a sense, but I think it has great potential.” The Citygram-Sound Project will soon be be showcased at the NoiseGate Festival, which is jointly organized by NYU and the United Nations Global Arts Initiative and supported by NYU’s Global Research Initiatives, Office of the Provost, from September 21st to 25th.


Marcin Pionnier on finishing 5th in the RTA competition
Marcin Pionnier on finishing 5th in the RTA compet ...

I graduated on Warsaw University of Technology with master thesis about text mining topic (intelligent web crawling methods). I work for Polish IT consulting company (Sollers Consulting), where I develop and design various insurance industry related stuff, (one of them is insurance fraud detection platform). From time to time I try to compete in data mining contests (Netflix, competitions on Kaggle and tunedit.org)?—?from my perspective it is a very good way to get real data mining experience.What I triedAs far as I remember, the basis of the solution I defined at the very beginning to create separate predictors for each individual loop and time interval. So my solution required me to build 61x10=610 regression models. I was playing with various regression algorithms, but quickly chose linear regression?—?because the results were good and the computation time was short. I think the key to get quite good result (especially on public RMSE ?? ) was the set of attributes used. I used the following attributes for the linear regression for each individual loop&time interval?—?number of minutes from 000 hours up to current moment (“now”)?—?average drive time for given loop&interval?—?loop times for current moment and some number of historical moments before (the number of time points and the loop varied between the methods)?—?differences between “neighboring” time moments for the above data just differences or differences transformed with logistic function (1/1+e^-difference). Use of logistic function gave a jump from public RMSE at about 198 to 189. The idea to use of sigmoid function here was just my intuition inspired by differences distribution.?—?“saturations” for for each loop (except the 2 first loops at both directions ).I introduced the simple (and very naive) model of traffic growth If the speed at given loop is up to 40 km/h?—?the saturation is 1;If the difference between the previous loop and the given loop is more than 5 km/h it is assumed that this road part is partially saturated there is segment that is moving at 30 km/h and second segment with the same speed as in the loop that is before given loop. The saturation is derived as the proportion of first segment to the whole road part. Each loop detector has its minimal value in RTAData file?—?after the regression this minimal value was used if predicted value was less than minimum.I did not use historical data at all?—?I found them useless during the initial tests (maybe too hastily). The only source of data for learning and testing was RTAData and lengths files (also no weekends, holidays, weather conditions).What ended up workingFor each of 610 regression models the following 3 models were competing. Models were being trained with all data availabe in RTAData file Model 1 For all (61) loops current + 5 times moments before and 5 simple differences?—?675 attributes, Model 2 For 10 before, current and next 9 loops (if available or less) current + 9 times moments before and 9 simple differences, saturations (for current time moment only)?—?204 to 404 atrributes, Model 3 For 10 before, current and next 9 loops (if available or less) current + 9 times moments before and 9 sigmoided differences, saturations (for current time moment only) 204 to 404 atrributes, Model with least RMSE computed on the train file was selected for particular loop. It is not a very good strategy, however I thought that generally linear regression was resistant to overfitting (it is not true?—?as the number of variable grows, the more variance can be explained?—?this is what I have learnt).This strategy gave me public RMSE 189.3I added also 4th model, that I just used for 15, 30 minutes predictions arbitrarily Model 4 For all (61) loops current + 5 times moments before and 5 sigmoided differences, saturations (for current time moment only)?—?614 attributes. This turn gave mi 188.6 public result.What is interesting, the best private solution (however not selected by me since I relied to much on public results) was 190.819 (public 197.979) , it was just the model 3 described above combined with model 5 (model 5 was used for 15,30,45,60,90 minutes predictions arbitrarily, rest model 3) Model 5 like model 3 but also loop times are “sigmoided” not only differences.What tools I usedMy solution is written as Java application with Weka linked as library (as always when I try to compete in data mining contests). Since linear regression requires to solve matrix equation (in this case quite huge), the memory allocated by the program was becoming more and more important issue (3,5GB for one thread)?—?at the of the competition i was using computer with 4 processors and 12 GB of RAM?—?with 3 separate threads building and testing the models. The whole computation for my last attempts took about 48 hours of computations.Originally published at blog.kaggle.com on February 17, 2011.Marcin Pionnier on finishing 5th in the RTA competition was originally published in Kaggle Blog on Medium, where people are continuing the conversation by highlighting and responding to this story.


GitHub Extension for Visual Studio not appearing i ...
Category: Git

Problem When you experience problems with Github Extension for Visual Studio 20 ...


Views: 365 Likes: 99
Bold text printing unbold
Category: Hardware

#If you're experiencing the #issue where #bold text is #printing unbold, you're not alone. This i ...


Views: 0 Likes: 30
Junior/Mid-Level Java Developer
Category: Jobs

Must-Haves Bachelor&rsquo;s Degree in IT or a related field ...


Views: 149 Likes: 107
Front-End Bootstrap Development Notes Tips and Tri ...
Category: .Net 7

How to remove borders from a Boostrap 5 Table Do you find yourself adding "border-0" to e ...


Views: 0 Likes: 27
FireWall UFW Ubuntu Mysql Allow Remote Connection
Category: SQL

Firewall UFW Ub ...


Views: 363 Likes: 95
Entity Framework Core 6 and 7 Tips and Tricks
Category: Entity Framework

Interceptors in EF Core 7- Use the TPC (Table per Concrete) Mapping strategy (prefer ...


Views: 0 Likes: 29
Full time Javascript Developer wanted!
Category: Jobs

An award winning account firm local to Cleveland/Akron, OH is looking for a mid level (3-6 years ...


Views: 38 Likes: 89
Front-end Developer opening in Canton, Ohio
Category: Jobs

I'm Jim Shelton and I am an IT specific recruiter. I&rsquo;m working with a small web de ...


Views: 0 Likes: 41

Login to Continue, We will bring you back to this content 0



For peering opportunity Autonomouse System Number: AS401345 Custom Software Development at ErnesTech Email Address[email protected]